-- Logs begin at Tue 2022-06-07 12:29:45 UTC, end at Tue 2022-06-07 13:36:38 UTC. -- Jun 07 13:05:00.259350 dv-cinder-844964-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 13:05:00.269314 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 13:05:00.269895 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 13:05:00 2022] *** Jun 07 13:05:00.269895 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 13:05:00.269895 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 13:05:00.269895 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: nodename: dv-cinder-844964-1-iscsi Jun 07 13:05:00.269895 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: machine: x86_64 Jun 07 13:05:00.269895 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: clock source: unix Jun 07 13:05:00.269895 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: pcre jit disabled Jun 07 13:05:00.269895 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: detected number of CPU cores: 4 Jun 07 13:05:00.269895 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: current working directory: / Jun 07 13:05:00.269895 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: detected binary path: /usr/bin/uwsgi-core Jun 07 13:05:00.270612 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: your processes number limit is 47680 Jun 07 13:05:00.270612 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: your memory page size is 4096 bytes Jun 07 13:05:00.270612 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: detected max file descriptor number: 2048 Jun 07 13:05:00.270612 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: lock engine: pthread robust mutexes Jun 07 13:05:00.270612 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: thunder lock: enabled Jun 07 13:05:00.270612 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 13:05:00.270612 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 13:05:00.315310 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: Python main interpreter initialized at 0x55a4db9d79c0 Jun 07 13:05:00.315310 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: python threads support enabled Jun 07 13:05:00.315310 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: your server socket listen backlog is limited to 100 connections Jun 07 13:05:00.315310 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: your mercy for graceful operations on workers is 90 seconds Jun 07 13:05:00.315714 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 13:05:00.315714 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: *** Operational MODE: preforking *** Jun 07 13:05:00.315981 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: *** uWSGI is running in multiple interpreter mode *** Jun 07 13:05:00.315981 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: spawned uWSGI master process (pid: 103393) Jun 07 13:05:00.316163 dv-cinder-844964-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 13:05:00.317001 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: spawned uWSGI worker 1 (pid: 103396, cores: 1) Jun 07 13:05:00.317001 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: spawned uWSGI worker 2 (pid: 103397, cores: 1) Jun 07 13:05:00.317692 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 13:05:01.527010 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 13:05:01.534554 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 13:05:02.235456 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:05:02.235456 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: from cryptography.utils import int_from_bytes Jun 07 13:05:02.235740 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:05:02.235740 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: from cryptography.utils import int_from_bytes Jun 07 13:05:02.237910 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:05:02.237910 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: from cryptography.utils import int_from_bytes Jun 07 13:05:02.238245 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:05:02.238245 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: from cryptography.utils import int_from_bytes Jun 07 13:05:04.801993 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 13:05:04.802573 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 13:05:04.802782 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 13:05:04.803141 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 13:05:04.803392 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 13:05:04.803775 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.804098 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.804416 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.804733 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.805072 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.805399 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.805716 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.806034 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.806360 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.806640 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.806957 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.807216 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 13:05:04.807594 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844964-1-iscsi {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.807679 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 13:05:04.807764 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.807871 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.807994 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 13:05:04.808176 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.808364 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 13:05:04.808490 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.808622 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 13:05:04.808791 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.809014 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.809109 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.809341 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.809434 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.809667 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.809871 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.809984 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.811066 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.811163 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.811231 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.811315 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.811388 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.811467 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.811533 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.811597 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.811661 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.811731 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.811894 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.811987 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.812188 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.812284 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.812519 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844964-1-iscsi {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.812658 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.812820 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.812908 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.813126 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.813276 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.813440 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.813534 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844964-1-iscsi {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.813762 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.813856 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.814071 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.814167 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.814396 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.814564 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.814733 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.814820 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.815129 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.815236 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.815437 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.815551 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.815755 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.815848 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.816075 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.816213 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.816379 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.816474 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.816705 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.816804 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.817030 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.817142 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.817336 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.817440 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.817652 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.817810 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.817950 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.818037 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.818253 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.818339 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.818581 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.818698 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844964-1-iscsi {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.818905 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.819021 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.819201 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.819337 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.819502 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.819654 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.819747 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.820039 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.820134 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.820358 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.820444 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.820672 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.820760 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.821019 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.821120 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.821269 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.821357 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.821515 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.821639 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.821832 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.821972 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.822149 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.822301 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.822854 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.822989 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.823112 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.823232 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.823339 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.823450 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.823565 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.823679 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.823784 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.823888 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.823992 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.824158 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.824272 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.824467 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.824587 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.824775 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.824888 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.825029 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.825150 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.825338 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.825457 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.825664 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.825795 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.825989 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.826114 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.826317 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.826467 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.826603 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.826728 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.826860 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.827011 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.827580 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.827712 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.827820 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.827924 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.828026 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.828141 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.828247 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.828359 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.828471 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.828583 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.828706 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.828819 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.828937 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.829075 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.829235 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.829362 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.829545 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.829665 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.831522 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.831793 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.831887 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.831985 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.832074 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.832155 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.832242 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.832321 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.832321 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.832532 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.832620 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.832700 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.832777 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.832854 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.832932 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.833018 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.833097 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.833175 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.833255 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.833341 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.833429 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.833509 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.833597 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.833682 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.833770 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.833849 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.833940 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.834026 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.834105 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.834189 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.834276 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.834520 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.834626 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.834834 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.834927 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.835159 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.835245 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.835477 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.835570 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.835783 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.835867 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.836035 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.836120 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.836339 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.836915 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.837160 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.837244 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.837467 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.837578 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.837782 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.837878 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.838083 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.838175 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.838386 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.838511 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.838716 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.838803 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.839016 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.839106 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.839318 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.839402 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.839623 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.839708 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.839922 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.840006 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.840224 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.840310 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.840529 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.840614 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.840825 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.840916 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.841126 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.841215 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.841429 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.841514 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.841728 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.841812 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.842030 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.842114 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.842329 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.842426 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.842652 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.842748 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.842953 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.843048 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.843252 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.843350 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.843550 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.843643 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.843847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.844010 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.844144 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.844230 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.844456 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.844542 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.844772 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.844866 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.845082 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.845168 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.845380 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.845464 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.845679 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.845773 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.845992 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.846077 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.846316 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.846401 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.846656 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.846757 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.846966 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.847051 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.847286 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.847371 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.847596 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.847683 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.847904 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.847996 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.848210 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.848297 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.848517 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.848610 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.848822 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.848907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.849129 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.849222 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.849435 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.849522 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.849740 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.849837 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.850042 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.850128 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.850356 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.850463 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.850695 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.850781 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.851006 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.851144 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.851316 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.851413 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.851624 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.851709 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.851937 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.852188 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:05:04.852814 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.852909 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.853123 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.853217 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.853451 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.853547 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.853773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.853858 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.854082 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.854176 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.854420 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.854575 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.854784 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.854872 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.855102 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.855188 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.855421 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.855517 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.855739 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.855824 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.856048 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.856134 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.856357 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.856461 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.856667 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.856753 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.856982 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.857079 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.857304 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.857390 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.857610 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.857695 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.857928 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.858014 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.858239 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.858335 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.858577 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.858680 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.858888 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.858975 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.859199 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.859286 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.859507 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.859600 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.859838 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.859923 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.860149 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.860290 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.860462 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.860561 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.860772 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.860876 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.861086 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.861172 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.861395 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.861484 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.861700 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.861795 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.862005 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.862099 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.862307 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.862393 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.862632 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.862731 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.862933 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.863027 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.863238 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.863331 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.863537 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.863636 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.863852 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.863940 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.864175 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.864261 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.864479 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.864578 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.864811 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.864898 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.865113 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.865200 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.865422 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.865508 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.865730 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.865823 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.866038 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.866131 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.866341 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.866453 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.866674 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.866762 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.866981 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.867067 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.867284 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.867372 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.867597 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.867683 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.867936 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.868021 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.868236 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.868321 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.868542 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.868626 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.868843 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.868942 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.869141 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.869250 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.869450 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.869540 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.869754 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.869848 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.870061 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.870155 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.870368 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.870475 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.870702 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.870808 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.871024 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.871117 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.871333 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.871467 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.871644 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.871738 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.871957 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.872043 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.872271 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.872357 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.872574 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.872660 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.872886 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.872971 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.873198 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.873306 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.873509 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.873602 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.873809 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.873895 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.874116 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.874202 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.874416 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.874531 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.874738 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.874836 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.875047 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.875133 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.875352 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.875439 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.875653 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.875740 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.875953 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.876047 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.876252 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.876339 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.876552 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.876638 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.876851 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.876949 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.877168 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.877254 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.877474 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.877569 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.877775 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.877870 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.878075 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.878247 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.878374 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.878488 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.878736 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.878838 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.879039 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.879137 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.879375 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.879460 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.879685 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.879780 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.879998 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.880084 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.880304 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.880390 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.880610 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.880704 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.880916 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.881001 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.881219 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.881311 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.881531 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.881653 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.881835 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.881935 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.882145 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.882243 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.882466 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.882565 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.882773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.882872 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.883089 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.883730 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.883908 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.884041 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.884214 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.884351 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.884522 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.884667 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.884828 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.884968 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.885130 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.885276 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.885448 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.885595 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.885785 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.885925 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.886117 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.886262 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.886430 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.886593 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.886771 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.886860 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.887079 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.887172 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.887392 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.887480 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.887700 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.887787 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.888008 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.888096 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.888318 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.888408 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.888625 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.888720 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.888941 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.889027 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.889248 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.889336 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.889561 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.889647 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.889867 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.889953 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.890188 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.890284 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.890522 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.890614 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.890839 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.890925 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.891145 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.891232 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.891457 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.891565 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.891782 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.891894 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.892109 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.892204 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.892417 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.892503 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.892727 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.892822 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.893047 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.893132 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.893355 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.893443 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.893664 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.893761 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.893972 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.894057 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.894272 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.894360 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.894598 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.894702 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.894909 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.894994 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.895222 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.895316 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.895538 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.895624 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.895847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.895941 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.896150 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.896236 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.896462 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.896551 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.896770 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.896856 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.897072 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.897157 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.897373 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.897459 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.897679 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.897771 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.897999 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.898085 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.898306 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.898393 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.898648 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.898744 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.899509 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.899615 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.899829 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.899915 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.900131 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.900216 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.900445 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.900539 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.900752 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.900836 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.901056 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.901148 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.901360 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.901454 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.901664 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.901816 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.901982 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.902104 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.902298 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.902399 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.902624 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.902740 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.902939 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.903044 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.903264 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.903357 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.903554 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.903656 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.903859 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.903952 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.904164 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.904251 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.904473 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.904567 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.904785 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.904879 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.905095 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.905181 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.905408 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.905502 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.905716 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.905803 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.906021 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.906107 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.906326 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.906411 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.906657 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.906746 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.906965 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.907061 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.907272 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.907358 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.907578 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.907674 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.907883 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.907969 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.908187 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.908273 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.908494 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.908603 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.908808 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.908895 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.909142 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.909374 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.909461 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.909703 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.909790 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.910015 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.910331 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.910418 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.910672 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.910769 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.910986 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.911073 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.911310 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.911404 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.911625 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.911712 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.911943 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.912042 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.912252 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.912355 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.912558 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.912646 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.912862 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.912949 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.913165 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.913251 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.913473 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.913561 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.913777 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.913863 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.914080 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.914166 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.914384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.914503 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.914739 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.914828 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.915044 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.915310 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.915408 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.915636 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.915728 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.915937 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.916023 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.916245 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.916333 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.916547 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.916634 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.916853 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.916949 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.917156 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.917244 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.917476 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.917564 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.917782 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.917876 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.918351 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.918716 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.918814 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.918896 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.918975 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.919054 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.919294 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.919404 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.919596 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.919683 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.919910 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.919996 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.920219 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.920320 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.920527 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.920615 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.920841 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.920927 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.921146 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.921234 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.921449 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.921534 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.921754 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.921849 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.922054 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.922159 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.922352 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.922498 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.922678 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.922768 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.922983 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.923070 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.923283 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.923370 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.923587 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.923674 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.923892 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.923979 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.924195 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.924280 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.924497 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.924590 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.924799 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.924894 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.925100 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.925186 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.925408 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.925504 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.925718 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.925815 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.926022 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.926108 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.926322 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.926421 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.926644 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.926732 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.926952 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.927040 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.927258 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.927357 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.927559 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.927657 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.927864 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.927951 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.928164 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.928252 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.928478 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.928564 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.928784 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.928901 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.929082 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.929188 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.929380 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.929477 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.929685 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.929782 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.929991 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.930089 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.930319 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.930468 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.930650 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.930752 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.930957 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.931044 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.931259 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.931382 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.931560 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.931821 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.931906 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.931984 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.932161 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.932392 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.932487 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.932579 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.932753 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.932841 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.933060 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.933147 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.933367 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.933463 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.933664 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.933769 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.933969 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.934055 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.934270 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.934366 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.934623 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.934711 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.934933 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.935032 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.935240 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.935330 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.935544 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.935631 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.935843 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.935929 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.936143 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.936230 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.936442 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.936529 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.936741 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.936828 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.937060 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.937147 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.937367 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.937461 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.937669 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.937756 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.937969 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.938064 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.938268 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.938354 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.938604 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.938694 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.938921 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.939009 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.939242 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.939336 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.939552 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.939658 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.939864 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.939952 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.940172 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.940267 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.940481 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.940581 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.940785 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.940916 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.941094 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.941179 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.941397 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.941501 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.941699 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.941784 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.942007 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.942314 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.942671 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.942843 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.942986 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.943131 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.943300 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.943449 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.943599 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.943765 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.943918 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.944061 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.944200 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.944362 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.944526 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.944674 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.944818 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.945124 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.945269 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.945412 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.945565 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.945708 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.946343 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.946552 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.946743 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.946880 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.947033 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.947174 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.947308 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.947434 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.947558 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.947708 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.947843 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.947932 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.948156 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.948252 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.948468 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.948610 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.948786 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.948901 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.949099 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.949218 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.949404 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.949516 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.949728 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.949817 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.950037 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.950132 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.950346 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.950543 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.950678 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.950776 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.951003 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.951098 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.951312 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.951400 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.951619 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.951705 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.951929 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.952024 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.952232 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.952342 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.952545 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.952663 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.952848 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.952945 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.953163 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.953285 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.953477 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.953596 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.953795 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.953907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.954111 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.954214 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.954426 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.954535 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.954764 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.954864 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.955075 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.955210 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.955391 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.955478 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.955705 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.955802 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.956018 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.956105 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.956346 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.956433 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.956662 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.956785 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.956974 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.957063 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.957288 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.957383 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.957586 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.957681 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.957894 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.957988 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.958239 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.958336 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.958531 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.958675 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.958836 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.958993 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.959143 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.959310 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.959466 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.959607 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.959745 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.959906 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.960045 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.960222 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.960455 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.960614 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.960760 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.960909 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.961045 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.961188 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.961985 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.962128 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.962299 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.962484 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.962662 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.962810 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.962944 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.963076 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.963264 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.963402 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.963587 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.963733 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.963874 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.964010 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.964188 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.964333 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.964495 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.964638 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.964821 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.964957 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.965130 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.965308 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.965436 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.965533 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.965749 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.965843 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.966051 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.966138 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.966372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.966495 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.966720 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.966825 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.967033 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.967120 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.967351 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.967512 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.967765 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.967853 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.968086 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.968172 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.968394 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.968493 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.968713 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.968801 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.969035 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.969123 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.969343 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.969452 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.969644 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.969733 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.969952 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.970038 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.970254 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.970340 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.970604 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.970697 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.970919 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.971006 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.971220 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.971314 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.971530 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.971626 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.971838 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.971933 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.972147 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.972247 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.972451 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.972538 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.972752 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.972838 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.973070 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.973190 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.973372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.973522 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.973692 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.973838 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.974006 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.974162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.974326 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.974522 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.974671 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.974836 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.974975 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.975145 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.975288 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.975459 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.975588 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.975768 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.975892 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.976077 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.976196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.976404 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.976490 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.976713 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.976833 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.977051 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.977161 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.977367 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.977482 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.977681 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.977811 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.977993 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.978140 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.978299 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.978475 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.978650 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.978802 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.978959 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.979131 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.979292 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.979440 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.979609 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.979742 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.979935 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.980063 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.980261 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.980356 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.980574 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.980662 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.980899 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.980986 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.981214 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.981302 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.981518 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.981605 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.981817 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.981904 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.982121 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.982217 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.982422 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.982530 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.982743 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.982840 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.983039 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.983135 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.983359 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.983501 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.983659 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.983791 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.983975 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.984127 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.984283 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.984422 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.984583 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.984722 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.984883 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.985030 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.985168 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.985314 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.985502 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.985637 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.985803 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.985941 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.986131 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.986269 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.986492 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.986631 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.986780 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.986916 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.987101 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.987250 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.987408 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.987545 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.987718 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.987855 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.988028 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.988166 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.988334 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.988471 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.988639 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.988772 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.988949 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.989084 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.989260 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.989407 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.989573 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.989716 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.989885 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.990020 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.990189 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.990368 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.990529 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.990616 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.990815 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.990904 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.991127 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.991222 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.991462 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.991683 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.991800 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.992007 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.992124 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.992318 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.992450 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.992649 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.992808 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.992962 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.993129 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.993273 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.993461 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.993581 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.993785 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.993892 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.994104 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.994192 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.994425 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.994540 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.994766 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.994853 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.995085 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.995173 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.995402 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.995489 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.995720 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.995810 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.996036 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.996124 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.996355 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.996449 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.996671 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.996766 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.996985 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.997080 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.997298 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.997539 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.997653 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.997873 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.997962 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.998193 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.998281 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.998535 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.998638 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.998855 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.998942 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.999174 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.999261 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.999481 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.999579 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.999788 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:04.999885 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.000097 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.000183 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.000406 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.000501 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.000715 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.000803 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.001022 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.001108 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.001353 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.001441 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.001665 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.001751 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.001985 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.002072 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.002309 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.002404 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.002649 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.002739 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.002960 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.003113 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.003272 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.003360 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.003585 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.003681 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.003932 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.004098 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.004243 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.004410 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.004561 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.004743 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.004882 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.005066 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.005202 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.005387 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.005518 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.005701 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.005832 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.006016 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.006148 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.006339 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.006485 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.006675 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.006806 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.006978 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.007120 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.007287 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.007439 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.007595 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.007756 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.007901 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.008085 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.008235 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.008957 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.009073 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.009283 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.009372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.009603 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.009689 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.009922 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.010027 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.010242 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.010517 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.010793 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.010882 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.011112 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.011216 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.011451 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.011538 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.011780 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.011868 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.012109 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.012210 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.012413 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.012499 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.012735 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.012821 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.013039 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.013136 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.013346 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.013433 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.013661 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.013757 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.013967 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.014054 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.014270 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.014357 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.014598 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.014687 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.014911 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.015000 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.015220 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.015307 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.015525 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.015607 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.015833 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.015938 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.016133 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.016220 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.016462 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.016671 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.016767 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.017023 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.017110 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.017346 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.017433 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.017651 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.017737 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.017953 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.018047 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.018255 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.018350 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.018579 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.018688 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.018882 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.018969 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.019191 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.019278 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.019494 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.019582 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.019800 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.019887 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.020103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.020191 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.020410 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.020497 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.020710 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.020798 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.021016 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.021112 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.021326 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.021412 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.021634 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.021728 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.021948 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.022043 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.022248 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.022335 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.022583 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.022686 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.022893 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.022990 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.023209 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.023295 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.023517 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.023645 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.023824 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.024489 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.024666 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.024753 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.024975 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.025062 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.025285 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.025523 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.025610 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.025864 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.025993 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.026184 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.026296 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.026516 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.026626 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.026829 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.026935 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.027143 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.027248 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.027453 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.027549 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.027755 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.027849 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.028079 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.028185 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.028391 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.028487 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.028703 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.028801 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.029009 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.029104 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.029318 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.029421 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.029627 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.029730 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.029936 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.030033 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.030246 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.030343 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.030580 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.030679 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.030889 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.030986 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.031196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.031306 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.031503 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.031767 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.031865 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.032104 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.032198 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.032419 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.032522 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.032756 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.032854 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.033069 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.033164 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.033381 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.033477 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.033691 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.033803 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.034001 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.034090 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.034304 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.034390 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.034635 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.034724 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.034941 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.035028 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.035247 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.035410 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.035559 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.035645 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.035876 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.035990 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.036187 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.036294 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.036495 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.036581 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.036808 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.036894 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.037118 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.037213 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.037430 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.037516 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.037742 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.037829 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.038055 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.038143 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.038365 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.038471 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.038725 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.038813 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.039045 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.039133 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.039366 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.039452 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.039702 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.039798 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.040022 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.040128 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.040341 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.040440 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.040655 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.040766 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.040963 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.041060 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.041269 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.041372 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.041572 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.041677 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.041875 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.041971 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.042182 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.042279 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.042514 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.042632 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.042819 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.042907 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.043390 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.043508 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.043694 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.043831 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.044002 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.044138 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.044306 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.044467 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.044627 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.044764 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.044909 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.045092 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.045230 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.045419 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.045568 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.045734 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.045872 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.046048 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.046201 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.046353 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.046475 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.046683 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.046783 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.046983 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.047078 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.047285 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.047373 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.047592 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.047679 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.047894 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.047981 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.048198 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.048293 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.048500 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.048588 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.048801 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.048899 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.049104 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.049193 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.049432 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.049521 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.049738 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.049833 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.050042 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.050187 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.050354 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.050461 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.050699 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.050798 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.051006 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.051093 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.051313 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.051400 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.051620 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.051717 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.051931 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.052063 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.052238 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.052327 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.052542 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.052637 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.052846 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.052932 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.053158 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.053254 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.053464 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.053557 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.053768 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.053855 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.054075 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.054205 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.054378 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.054501 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.054709 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.054805 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.055011 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.055096 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.055345 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.055434 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.055649 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.055735 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.055972 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.056097 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.056288 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.056426 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.056610 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.056697 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.056925 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.057023 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.057234 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.057319 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.057559 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.057644 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.057869 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.057966 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.058176 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.058262 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.058508 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.058602 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.058819 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.058921 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.059127 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.059215 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.059439 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.059527 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.059754 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.059842 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.060067 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.060154 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.060385 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.060491 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.060692 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.060787 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.061002 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.061089 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.061314 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.061403 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.061629 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.061717 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.061956 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.062043 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.062263 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.062358 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.062653 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.062742 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.062970 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.063066 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.063281 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.063381 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.063585 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.063672 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.063826 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 13:05:05.063921 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.064229 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.064546 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.064862 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.065182 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.065495 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.065808 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.066126 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.066471 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.066799 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.067127 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.067443 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.067771 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.068102 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.068456 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.068773 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.069121 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.069455 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.069774 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.070089 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.070399 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:05:05.070668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 13:05:05.121083 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO dbcounter [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] Registered counter for database nova_api Jun 07 13:05:05.128561 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO dbcounter [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] Registered counter for database nova_api Jun 07 13:05:05.141116 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_db.sqlalchemy.engines [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:05:05.147787 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG dbcounter [-] [103396] Writer thread running {{(pid=103396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:05:05.148336 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG oslo_db.sqlalchemy.engines [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103397) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:05:05.155389 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG dbcounter [-] [103397] Writer thread running {{(pid=103397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:05:05.205011 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.context [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ea3ea752-fefa-4f40-8c99-d2fb2240d3ce(cell1) {{(pid=103396) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 13:05:05.209219 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:05:05.210850 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:05:05.212050 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.context [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ea3ea752-fefa-4f40-8c99-d2fb2240d3ce(cell1) {{(pid=103397) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 13:05:05.212249 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:05:05.214223 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:05:05.216127 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG oslo_concurrency.lockutils [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103397) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:05:05.216252 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO dbcounter [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] Registered counter for database nova_cell0 Jun 07 13:05:05.217746 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG oslo_concurrency.lockutils [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103397) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:05:05.218849 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG oslo_concurrency.lockutils [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103397) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:05:05.220262 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO dbcounter [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] Registered counter for database nova_cell1 Jun 07 13:05:05.220815 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG oslo_concurrency.lockutils [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103397) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:05:05.222892 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO dbcounter [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] Registered counter for database nova_cell0 Jun 07 13:05:05.227222 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO dbcounter [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] Registered counter for database nova_cell1 Jun 07 13:05:05.227539 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_db.sqlalchemy.engines [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:05:05.229788 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_db.sqlalchemy.engines [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:05:05.235059 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG dbcounter [-] [103396] Writer thread running {{(pid=103396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:05:05.235286 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG oslo_db.sqlalchemy.engines [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103397) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:05:05.237718 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG oslo_db.sqlalchemy.engines [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103397) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:05:05.237882 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG dbcounter [-] [103396] Writer thread running {{(pid=103396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:05:05.242279 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG dbcounter [-] [103397] Writer thread running {{(pid=103397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:05:05.378717 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG dbcounter [-] [103397] Writer thread running {{(pid=103397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:05:05.382202 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO dbcounter [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] Registered counter for database nova_cell0 Jun 07 13:05:05.388466 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO dbcounter [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] Registered counter for database nova_cell0 Jun 07 13:05:05.391193 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_db.sqlalchemy.engines [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:05:05.395071 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG oslo_db.sqlalchemy.engines [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103397) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:05:05.395718 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG dbcounter [-] [103396] Writer thread running {{(pid=103396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:05:05.399894 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG dbcounter [-] [103397] Writer thread running {{(pid=103397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:05:05.854572 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: WARNING keystonemiddleware.auth_token [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:05:05.855059 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: WARNING keystonemiddleware.auth_token [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:05:05.861864 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: WARNING keystonemiddleware.auth_token [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:05:05.861977 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: WARNING keystonemiddleware.auth_token [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:05:06.085892 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: WARNING keystonemiddleware.auth_token [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:05:06.087126 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: WARNING keystonemiddleware.auth_token [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:05:06.091852 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: WARNING keystonemiddleware.auth_token [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:05:06.093078 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: WARNING keystonemiddleware.auth_token [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:05:06.097934 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4db9d79c0 pid: 103397 (default app) Jun 07 13:05:06.098192 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4db9d79c0 pid: 103396 (default app) Jun 07 13:05:06.100021 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:06.101213 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-e47b9638-c881-4352-a368-add8b03854e4 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001725 Jun 07 13:05:06.101610 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Tue Jun 7 13:05:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:06:24.248335 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:24.249549 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003185 Jun 07 13:06:24.249950 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jun 7 13:06:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:06:24.269190 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG dbcounter [-] [103397] Writing DB stats nova_api:SELECT=3 {{(pid=103397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:06:24.270683 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG dbcounter [-] [103397] Writing DB stats nova_cell0:SELECT=3 {{(pid=103397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:06:24.271861 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG dbcounter [-] [103397] Writing DB stats nova_cell1:SELECT=3 {{(pid=103397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:06:24.273019 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG dbcounter [-] [103397] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:06:24.705196 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-72bae1ca-e91b-47a7-b68d-f1a80b0bd7c5 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:24.735371 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-72bae1ca-e91b-47a7-b68d-f1a80b0bd7c5 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.479362 Jun 07 13:06:24.736245 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 2/3] 10.222.0.58 () {60 vars in 1291 bytes} [Tue Jun 7 13:06:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:06:27.049602 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:27.050648 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-53b98b2a-ebae-49dd-ac62-80db42af7f17 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 07 13:06:27.051042 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 2/4] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jun 7 13:06:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:06:27.108972 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-9c5431c1-13a3-4236-9f7b-d8a41a98af29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 256, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:27.127303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:06:27.127303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: warnings.warn(msg) Jun 07 13:06:27.154810 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-9c5431c1-13a3-4236-9f7b-d8a41a98af29 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.097350 Jun 07 13:06:27.155674 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 3/5] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jun 7 13:06:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:06:27.168893 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG dbcounter [-] [103396] Writing DB stats nova_api:SELECT=3 {{(pid=103396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:06:27.169830 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG dbcounter [-] [103396] Writing DB stats nova_cell1:SELECT=3 {{(pid=103396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:06:27.170861 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG dbcounter [-] [103396] Writing DB stats nova_cell0:SELECT=3 {{(pid=103396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:06:27.171583 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG dbcounter [-] [103396] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:06:27.375255 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-93a5a595-4352-4545-b03e-ff670406cb84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:27.377607 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:06:27.377607 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: warnings.warn(msg) Jun 07 13:06:27.440122 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-93a5a595-4352-4545-b03e-ff670406cb84 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.276663 Jun 07 13:06:27.440707 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 3/6] 10.222.0.58 () {64 vars in 1335 bytes} [Tue Jun 7 13:06:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:06:29.723888 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-9c5431c1-13a3-4236-9f7b-d8a41a98af29 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:29.727041 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-9c5431c1-13a3-4236-9f7b-d8a41a98af29 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005609 Jun 07 13:06:29.727956 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 4/7] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jun 7 13:06:29 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:06:29.843415 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-c8310663-da42-4ff5-b7d5-aedbf32a062b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "vcpus": 1, "ram": 512, "swap": 0}} {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:29.861354 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:06:29.861354 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: warnings.warn(msg) Jun 07 13:06:29.880527 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-c8310663-da42-4ff5-b7d5-aedbf32a062b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145818 Jun 07 13:06:29.888216 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 4/8] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jun 7 13:06:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:06:29.893242 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-379ed78e-a8ff-4edb-b683-1f00bf079b0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:29.894778 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:06:29.894778 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: warnings.warn(msg) Jun 07 13:06:29.927217 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-379ed78e-a8ff-4edb-b683-1f00bf079b0d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037095 Jun 07 13:06:29.928410 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 5/9] 10.222.0.58 () {64 vars in 1335 bytes} [Tue Jun 7 13:06:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:06:32.283432 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-c8310663-da42-4ff5-b7d5-aedbf32a062b admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:32.285033 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-c8310663-da42-4ff5-b7d5-aedbf32a062b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002464 Jun 07 13:06:32.285612 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jun 7 13:06:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:06:32.352282 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-85a6fa87-e949-4617-aa28-70f94c19e4e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "id": "d2", "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:32.370068 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-85a6fa87-e949-4617-aa28-70f94c19e4e9 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077371 Jun 07 13:06:32.370671 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 6/11] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jun 7 13:06:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:06:32.383436 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-1b7e4f0d-1dee-4b46-b082-1b0ea86d7db1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:32.409750 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-1b7e4f0d-1dee-4b46-b082-1b0ea86d7db1 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029896 Jun 07 13:06:32.410480 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 6/12] 10.222.0.58 () {64 vars in 1335 bytes} [Tue Jun 7 13:06:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:06:34.766096 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-85a6fa87-e949-4617-aa28-70f94c19e4e9 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:34.767194 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-85a6fa87-e949-4617-aa28-70f94c19e4e9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Jun 07 13:06:34.767609 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 7/13] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jun 7 13:06:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:06:34.829678 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-f9b4ab62-1895-4bf7-9620-14af923527c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "id": "d3", "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:34.848856 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-f9b4ab62-1895-4bf7-9620-14af923527c9 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074691 Jun 07 13:06:34.850488 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 7/14] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jun 7 13:06:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:06:34.862157 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-e1fa6abf-3d7f-4dda-8a27-3e1baa1a960d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:34.887243 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-e1fa6abf-3d7f-4dda-8a27-3e1baa1a960d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028758 Jun 07 13:06:34.888124 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 8/15] 10.222.0.58 () {64 vars in 1335 bytes} [Tue Jun 7 13:06:34 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:06:37.231397 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-f9b4ab62-1895-4bf7-9620-14af923527c9 admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:37.232402 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-f9b4ab62-1895-4bf7-9620-14af923527c9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 07 13:06:37.232837 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 8/16] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jun 7 13:06:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:06:37.293241 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-33f5bc2f-679f-46f4-bcf6-2a7cab48bbd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:37.311513 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-33f5bc2f-679f-46f4-bcf6-2a7cab48bbd8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072904 Jun 07 13:06:37.312212 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 9/17] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jun 7 13:06:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:06:37.324813 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-4940d4e2-d162-4124-a310-e82a649c7073 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:37.357395 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-4940d4e2-d162-4124-a310-e82a649c7073 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036133 Jun 07 13:06:37.358457 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 9/18] 10.222.0.58 () {64 vars in 1335 bytes} [Tue Jun 7 13:06:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:06:39.633733 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-33f5bc2f-679f-46f4-bcf6-2a7cab48bbd8 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:39.635421 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-33f5bc2f-679f-46f4-bcf6-2a7cab48bbd8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002054 Jun 07 13:06:39.636141 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 10/19] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jun 7 13:06:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:06:39.698156 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-18ea9006-f220-45dd-950d-fa9e5a85c6c6 admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:39.722037 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-18ea9006-f220-45dd-950d-fa9e5a85c6c6 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079760 Jun 07 13:06:39.722809 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 10/20] 10.222.0.58 () {60 vars in 1291 bytes} [Tue Jun 7 13:06:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:06:42.031277 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-33f5bc2f-679f-46f4-bcf6-2a7cab48bbd8 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:42.032550 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-33f5bc2f-679f-46f4-bcf6-2a7cab48bbd8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001764 Jun 07 13:06:42.032968 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 11/21] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jun 7 13:06:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:06:42.092080 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-b638fee1-1485-4445-8e68-a15032e42fd4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:42.109356 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-b638fee1-1485-4445-8e68-a15032e42fd4 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070025 Jun 07 13:06:42.109906 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 11/22] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jun 7 13:06:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:06:42.122142 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-6b1c152e-fdff-4e9d-8d35-c689542caac3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:42.145587 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-6b1c152e-fdff-4e9d-8d35-c689542caac3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027066 Jun 07 13:06:42.146204 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 12/23] 10.222.0.58 () {64 vars in 1332 bytes} [Tue Jun 7 13:06:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:06:44.429167 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-b638fee1-1485-4445-8e68-a15032e42fd4 admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:44.430259 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-b638fee1-1485-4445-8e68-a15032e42fd4 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jun 07 13:06:44.430747 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 12/24] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jun 7 13:06:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:06:44.503521 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-161ecb34-6bd0-4bc6-89f4-9050afa7eb1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "disk": 20, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:44.525394 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-161ecb34-6bd0-4bc6-89f4-9050afa7eb1a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088451 Jun 07 13:06:44.526105 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 13/25] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jun 7 13:06:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:06:44.538014 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-85a0f3f3-a1f4-4272-9414-a05ec27983c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:44.560955 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-85a0f3f3-a1f4-4272-9414-a05ec27983c3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026574 Jun 07 13:06:44.561530 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 13/26] 10.222.0.58 () {64 vars in 1332 bytes} [Tue Jun 7 13:06:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:06:46.934479 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-161ecb34-6bd0-4bc6-89f4-9050afa7eb1a admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:46.935515 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-161ecb34-6bd0-4bc6-89f4-9050afa7eb1a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 07 13:06:46.935918 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 14/27] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jun 7 13:06:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:06:46.993583 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-a5ea9f12-a4fd-48b6-9999-273c7f9ca9b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:47.010911 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-a5ea9f12-a4fd-48b6-9999-273c7f9ca9b0 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069201 Jun 07 13:06:47.011857 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 14/28] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jun 7 13:06:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:06:47.023397 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-0b2a3cfa-1d36-4972-b4d3-b1040d977c0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:47.047071 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-0b2a3cfa-1d36-4972-b4d3-b1040d977c0c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027375 Jun 07 13:06:47.047639 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 15/29] 10.222.0.58 () {64 vars in 1332 bytes} [Tue Jun 7 13:06:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:06:49.313585 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-a5ea9f12-a4fd-48b6-9999-273c7f9ca9b0 admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:49.314618 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-a5ea9f12-a4fd-48b6-9999-273c7f9ca9b0 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 07 13:06:49.315210 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 15/30] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jun 7 13:06:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:06:49.382107 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-a7fb8377-f1d9-4b9b-a050-1b279695302e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "name": "m1.large", "id": "4", "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:49.401740 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-a7fb8377-f1d9-4b9b-a050-1b279695302e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079725 Jun 07 13:06:49.402300 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 16/31] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jun 7 13:06:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:06:49.413894 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-0e4add8c-0dfd-49db-9390-519d9a3f1f99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:49.440296 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-0e4add8c-0dfd-49db-9390-519d9a3f1f99 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029949 Jun 07 13:06:49.440877 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 16/32] 10.222.0.58 () {64 vars in 1332 bytes} [Tue Jun 7 13:06:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:06:51.763718 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-a7fb8377-f1d9-4b9b-a050-1b279695302e admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:51.765347 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-a7fb8377-f1d9-4b9b-a050-1b279695302e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002116 Jun 07 13:06:51.766193 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 17/33] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jun 7 13:06:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:06:51.868711 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-d1899d18-4708-49f6-88f7-6de1b02ad9aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:51.890858 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-d1899d18-4708-49f6-88f7-6de1b02ad9aa admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.117201 Jun 07 13:06:51.892293 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 17/34] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jun 7 13:06:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:06:51.904805 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-8cfcc666-4489-4126-8d93-cb4830c7b8f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:06:51.931957 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-8cfcc666-4489-4126-8d93-cb4830c7b8f9 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030857 Jun 07 13:06:51.932566 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 18/35] 10.222.0.58 () {64 vars in 1332 bytes} [Tue Jun 7 13:06:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:07:16.531088 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-d1899d18-4708-49f6-88f7-6de1b02ad9aa admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:16.532120 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-d1899d18-4708-49f6-88f7-6de1b02ad9aa admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jun 07 13:07:16.532511 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 18/36] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jun 7 13:07:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:07:16.543477 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG dbcounter [-] [103397] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:07:16.592872 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-9f74fa09-b67e-4fb1-b51f-915e660ea7d9 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:16.609453 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-9f74fa09-b67e-4fb1-b51f-915e660ea7d9 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070960 Jun 07 13:07:16.609988 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 19/37] 10.222.0.58 () {60 vars in 1291 bytes} [Tue Jun 7 13:07:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:07:17.605382 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-d1899d18-4708-49f6-88f7-6de1b02ad9aa admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:17.606389 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-d1899d18-4708-49f6-88f7-6de1b02ad9aa admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 07 13:07:17.606847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 19/38] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jun 7 13:07:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:07:17.806384 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-b8edb1bc-1477-423f-8e76-1b9ca7d4ea68 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:17.811964 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.wsgi [None req-b8edb1bc-1477-423f-8e76-1b9ca7d4ea68 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-b8edb1bc-1477-423f-8e76-1b9ca7d4ea68 admin admin] Request method failure captured: Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Accept: application/json Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Accept-Encoding: gzip, deflate Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Connection: keep-alive Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Content-Length: 0 Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Host: 10.222.0.58 Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Openstack-Api-Version: compute 2.90 Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Openstack-System-Scope: None Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: User-Agent: python-novaclient Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Auth-Token: gAAAAABin02FvWFFe15a3Fcolp-RMc25ZhlsKgK9AW8rN9ok2bWLHawrDtLjZQ3PoRGmfIErZ3RSHpxo4E9QuCakxCYc1f9yjQmlwQG1LLdnTmo3VsZyv0Ns4oO3doByd7pK82VcPB5KcaFXgkX2Ir95FR_F7Lh4GK10f6h1KPak8y3ot2LHqTE Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Domain-Id: None Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Domain-Name: None Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Identity-Status: Confirmed Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Is-Admin-Project: True Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Project-Domain-Id: default Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Project-Domain-Name: Default Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Project-Id: 77d99f4c9bdc47a48c41bcdeaf517d54 Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Project-Name: admin Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Role: member,reader,admin Jun 07 13:07:17.815225 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Roles: member,reader,admin Jun 07 13:07:17.816827 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_77d99f4c9bdc47a48c41bcdeaf517d54", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:07:17.816827 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Tenant: admin Jun 07 13:07:17.816827 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Tenant-Id: 77d99f4c9bdc47a48c41bcdeaf517d54 Jun 07 13:07:17.816827 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Tenant-Name: admin Jun 07 13:07:17.816827 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-User: admin Jun 07 13:07:17.816827 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-User-Domain-Id: default Jun 07 13:07:17.816827 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-User-Domain-Name: Default Jun 07 13:07:17.816827 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-User-Id: 0d2d4d42368343ecbcecbcb439b6763e Jun 07 13:07:17.816827 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-User-Name: admin Jun 07 13:07:17.816827 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: method: > Jun 07 13:07:17.816827 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: exception: Flavor 42 could not be found. Jun 07 13:07:17.816827 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: action_args: {'id': '42'} Jun 07 13:07:17.816827 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:07:17.816827 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:07:17.818668 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Jun 07 13:07:17.820162 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-b8edb1bc-1477-423f-8e76-1b9ca7d4ea68 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103397) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:07:17.821425 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-b8edb1bc-1477-423f-8e76-1b9ca7d4ea68 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062237 Jun 07 13:07:17.821425 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 20/39] 10.222.0.58 () {60 vars in 1190 bytes} [Tue Jun 7 13:07:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 13:07:17.826881 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-683ae246-9ebd-43a7-b41d-70c5ae1d3c00 admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:17.829851 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG dbcounter [-] [103396] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:07:17.851258 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-683ae246-9ebd-43a7-b41d-70c5ae1d3c00 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028020 Jun 07 13:07:17.851811 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 20/40] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Jun 7 13:07:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:07:17.869131 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-6f000114-bef0-4106-a815-ce2c620684dd admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:17.890496 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-6f000114-bef0-4106-a815-ce2c620684dd admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024913 Jun 07 13:07:17.891037 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 21/41] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Jun 7 13:07:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:07:17.900823 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-24e388e9-9a3d-428e-9f72-5dee812de249 admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:17.906917 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.wsgi [None req-24e388e9-9a3d-428e-9f72-5dee812de249 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-24e388e9-9a3d-428e-9f72-5dee812de249 admin admin] Request method failure captured: Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Accept: application/json Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Accept-Encoding: gzip, deflate Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Connection: keep-alive Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Content-Length: 0 Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Host: 10.222.0.58 Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Openstack-Api-Version: compute 2.90 Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Openstack-System-Scope: None Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: User-Agent: python-novaclient Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Auth-Token: gAAAAABin02FvWFFe15a3Fcolp-RMc25ZhlsKgK9AW8rN9ok2bWLHawrDtLjZQ3PoRGmfIErZ3RSHpxo4E9QuCakxCYc1f9yjQmlwQG1LLdnTmo3VsZyv0Ns4oO3doByd7pK82VcPB5KcaFXgkX2Ir95FR_F7Lh4GK10f6h1KPak8y3ot2LHqTE Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Domain-Id: None Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Domain-Name: None Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Identity-Status: Confirmed Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Is-Admin-Project: True Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Project-Domain-Id: default Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Project-Domain-Name: Default Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Project-Id: 77d99f4c9bdc47a48c41bcdeaf517d54 Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Project-Name: admin Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Role: member,reader,admin Jun 07 13:07:17.910103 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Roles: member,reader,admin Jun 07 13:07:17.911773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_77d99f4c9bdc47a48c41bcdeaf517d54", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:07:17.911773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Tenant: admin Jun 07 13:07:17.911773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Tenant-Id: 77d99f4c9bdc47a48c41bcdeaf517d54 Jun 07 13:07:17.911773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Tenant-Name: admin Jun 07 13:07:17.911773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-User: admin Jun 07 13:07:17.911773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-User-Domain-Id: default Jun 07 13:07:17.911773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-User-Domain-Name: Default Jun 07 13:07:17.911773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-User-Id: 0d2d4d42368343ecbcecbcb439b6763e Jun 07 13:07:17.911773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-User-Name: admin Jun 07 13:07:17.911773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: method: > Jun 07 13:07:17.911773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: exception: Flavor 42 could not be found. Jun 07 13:07:17.911773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: action_args: {'id': '42'} Jun 07 13:07:17.911773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:07:17.911773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:07:17.912907 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Jun 07 13:07:17.914196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-24e388e9-9a3d-428e-9f72-5dee812de249 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:07:17.915443 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-24e388e9-9a3d-428e-9f72-5dee812de249 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014239 Jun 07 13:07:17.915443 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 21/42] 10.222.0.58 () {60 vars in 1190 bytes} [Tue Jun 7 13:07:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 13:07:18.771795 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-6f000114-bef0-4106-a815-ce2c620684dd admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:18.772839 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-6f000114-bef0-4106-a815-ce2c620684dd admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001990 Jun 07 13:07:18.773238 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 22/43] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jun 7 13:07:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:07:18.961571 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-02c38704-5a8c-4971-8936-dd2b0a987711 admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:18.966883 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.wsgi [None req-02c38704-5a8c-4971-8936-dd2b0a987711 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-02c38704-5a8c-4971-8936-dd2b0a987711 admin admin] Request method failure captured: Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Accept: application/json Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Accept-Encoding: gzip, deflate Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Connection: keep-alive Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Content-Length: 0 Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Host: 10.222.0.58 Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Openstack-Api-Version: compute 2.90 Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Openstack-System-Scope: None Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: User-Agent: python-novaclient Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Auth-Token: gAAAAABin02GKA0XD7wECNjczKK-uEqli7nZCyv2xh8HokUIxzCyeitb9QSVha-qImMtGmbtxY5OO9Vpzz8_ssIYtgh_rkb0RFHiN0eeBByXef2KEsk8w2eQNWND5vhdN6F11HcFujRvZIvZdM8TrAm8KvyqvZ_T43gOpIUcW46alHPuNzdB3Is Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Domain-Id: None Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Domain-Name: None Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Identity-Status: Confirmed Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Is-Admin-Project: True Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Project-Domain-Id: default Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Project-Domain-Name: Default Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Project-Id: 77d99f4c9bdc47a48c41bcdeaf517d54 Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Project-Name: admin Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Role: member,reader,admin Jun 07 13:07:18.968384 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Roles: member,reader,admin Jun 07 13:07:18.969912 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_77d99f4c9bdc47a48c41bcdeaf517d54", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:07:18.969912 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Tenant: admin Jun 07 13:07:18.969912 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Tenant-Id: 77d99f4c9bdc47a48c41bcdeaf517d54 Jun 07 13:07:18.969912 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Tenant-Name: admin Jun 07 13:07:18.969912 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-User: admin Jun 07 13:07:18.969912 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-User-Domain-Id: default Jun 07 13:07:18.969912 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-User-Domain-Name: Default Jun 07 13:07:18.969912 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-User-Id: 0d2d4d42368343ecbcecbcb439b6763e Jun 07 13:07:18.969912 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-User-Name: admin Jun 07 13:07:18.969912 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: method: > Jun 07 13:07:18.969912 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: exception: Flavor 84 could not be found. Jun 07 13:07:18.969912 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: action_args: {'id': '84'} Jun 07 13:07:18.969912 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:07:18.969912 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:07:18.970783 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Jun 07 13:07:18.971847 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-02c38704-5a8c-4971-8936-dd2b0a987711 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:07:18.972882 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-02c38704-5a8c-4971-8936-dd2b0a987711 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061003 Jun 07 13:07:18.972882 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 22/44] 10.222.0.58 () {60 vars in 1190 bytes} [Tue Jun 7 13:07:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 13:07:18.980191 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-8717dcb3-a72e-4a93-bdf2-5673fe35fa8e admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:18.993658 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-8717dcb3-a72e-4a93-bdf2-5673fe35fa8e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017081 Jun 07 13:07:18.994128 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 23/45] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Jun 7 13:07:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:07:19.003169 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-0e6f591c-4983-45c6-94ed-80304bf1fc60 admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:19.016835 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-0e6f591c-4983-45c6-94ed-80304bf1fc60 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017205 Jun 07 13:07:19.017337 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 23/46] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Jun 7 13:07:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:07:19.026921 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-932572c6-b886-482a-b4a9-943d0881acda admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:19.032161 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.wsgi [None req-932572c6-b886-482a-b4a9-943d0881acda admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-932572c6-b886-482a-b4a9-943d0881acda admin admin] Request method failure captured: Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Accept: application/json Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Accept-Encoding: gzip, deflate Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Connection: keep-alive Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Content-Length: 0 Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Host: 10.222.0.58 Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Openstack-Api-Version: compute 2.90 Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Openstack-System-Scope: None Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: User-Agent: python-novaclient Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Auth-Token: gAAAAABin02GKA0XD7wECNjczKK-uEqli7nZCyv2xh8HokUIxzCyeitb9QSVha-qImMtGmbtxY5OO9Vpzz8_ssIYtgh_rkb0RFHiN0eeBByXef2KEsk8w2eQNWND5vhdN6F11HcFujRvZIvZdM8TrAm8KvyqvZ_T43gOpIUcW46alHPuNzdB3Is Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Domain-Id: None Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Domain-Name: None Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Identity-Status: Confirmed Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Is-Admin-Project: True Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Project-Domain-Id: default Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Project-Domain-Name: Default Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Project-Id: 77d99f4c9bdc47a48c41bcdeaf517d54 Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Project-Name: admin Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Role: member,reader,admin Jun 07 13:07:19.033684 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Roles: member,reader,admin Jun 07 13:07:19.035243 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_77d99f4c9bdc47a48c41bcdeaf517d54", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:07:19.035243 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Tenant: admin Jun 07 13:07:19.035243 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Tenant-Id: 77d99f4c9bdc47a48c41bcdeaf517d54 Jun 07 13:07:19.035243 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Tenant-Name: admin Jun 07 13:07:19.035243 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-User: admin Jun 07 13:07:19.035243 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-User-Domain-Id: default Jun 07 13:07:19.035243 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-User-Domain-Name: Default Jun 07 13:07:19.035243 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-User-Id: 0d2d4d42368343ecbcecbcb439b6763e Jun 07 13:07:19.035243 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-User-Name: admin Jun 07 13:07:19.035243 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: method: > Jun 07 13:07:19.035243 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: exception: Flavor 84 could not be found. Jun 07 13:07:19.035243 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: action_args: {'id': '84'} Jun 07 13:07:19.035243 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:07:19.035243 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:07:19.036352 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Jun 07 13:07:19.038246 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-932572c6-b886-482a-b4a9-943d0881acda admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103397) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:07:19.039505 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-932572c6-b886-482a-b4a9-943d0881acda admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011656 Jun 07 13:07:19.039505 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 24/47] 10.222.0.58 () {60 vars in 1190 bytes} [Tue Jun 7 13:07:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 07 13:07:19.893789 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-0e6f591c-4983-45c6-94ed-80304bf1fc60 admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:19.894828 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-0e6f591c-4983-45c6-94ed-80304bf1fc60 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 07 13:07:19.895223 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 24/48] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jun 7 13:07:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:07:20.084592 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-ba49f2f1-2592-4ec1-bad7-a078dc50a711 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:20.090276 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.wsgi [None req-ba49f2f1-2592-4ec1-bad7-a078dc50a711 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-ba49f2f1-2592-4ec1-bad7-a078dc50a711 admin admin] Request method failure captured: Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Accept: application/json Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Accept-Encoding: gzip, deflate Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Connection: keep-alive Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Content-Length: 0 Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Host: 10.222.0.58 Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Openstack-Api-Version: compute 2.90 Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Openstack-System-Scope: None Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: User-Agent: python-novaclient Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Auth-Token: gAAAAABin02HbSHxQRb5lHzA1QVyhiJfbpX5BLBwprl_-CyNf_1ROFjMo50qrHsmF0mOENXw_1aYBB5QJ821x1fnFAW-EhSP2u6Ub5mMJZ9Sm1YivOWdtd9Pyk-qWRztWlgyc_3WZoTnaVFqBRFu6BqQe3ZqYzr0os_S1OfYi9IGEEikQQl9oFc Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Domain-Id: None Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Domain-Name: None Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Identity-Status: Confirmed Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Is-Admin-Project: True Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Project-Domain-Id: default Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Project-Domain-Name: Default Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Project-Id: 77d99f4c9bdc47a48c41bcdeaf517d54 Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Project-Name: admin Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Role: member,reader,admin Jun 07 13:07:20.091814 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Roles: member,reader,admin Jun 07 13:07:20.093429 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_77d99f4c9bdc47a48c41bcdeaf517d54", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:07:20.093429 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Tenant: admin Jun 07 13:07:20.093429 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Tenant-Id: 77d99f4c9bdc47a48c41bcdeaf517d54 Jun 07 13:07:20.093429 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-Tenant-Name: admin Jun 07 13:07:20.093429 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-User: admin Jun 07 13:07:20.093429 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-User-Domain-Id: default Jun 07 13:07:20.093429 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-User-Domain-Name: Default Jun 07 13:07:20.093429 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-User-Id: 0d2d4d42368343ecbcecbcb439b6763e Jun 07 13:07:20.093429 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: X-User-Name: admin Jun 07 13:07:20.093429 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: method: > Jun 07 13:07:20.093429 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: exception: Flavor 451 could not be found. Jun 07 13:07:20.093429 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: action_args: {'id': '451'} Jun 07 13:07:20.093429 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:07:20.093429 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:07:20.094303 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: ERROR nova.api.openstack.wsgi Jun 07 13:07:20.095458 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-ba49f2f1-2592-4ec1-bad7-a078dc50a711 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103397) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:07:20.096453 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-ba49f2f1-2592-4ec1-bad7-a078dc50a711 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062055 Jun 07 13:07:20.096453 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 25/49] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Jun 7 13:07:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 13:07:20.103505 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-e4e9adc5-0aa3-4110-901b-4af766e078bd admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:20.117726 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-e4e9adc5-0aa3-4110-901b-4af766e078bd admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017891 Jun 07 13:07:20.118256 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 25/50] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Jun 7 13:07:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:07:20.127843 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-133518fd-f1ad-42ca-a29d-f7b7f93cc896 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:20.141361 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-133518fd-f1ad-42ca-a29d-f7b7f93cc896 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017086 Jun 07 13:07:20.141890 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 26/51] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Jun 7 13:07:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:07:20.151018 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-e1342bdb-e807-47be-99f3-3b0b3e519f63 admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:20.156283 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.wsgi [None req-e1342bdb-e807-47be-99f3-3b0b3e519f63 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-e1342bdb-e807-47be-99f3-3b0b3e519f63 admin admin] Request method failure captured: Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Accept: application/json Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Accept-Encoding: gzip, deflate Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Connection: keep-alive Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Content-Length: 0 Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Host: 10.222.0.58 Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Openstack-Api-Version: compute 2.90 Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Openstack-System-Scope: None Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: User-Agent: python-novaclient Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Auth-Token: gAAAAABin02HbSHxQRb5lHzA1QVyhiJfbpX5BLBwprl_-CyNf_1ROFjMo50qrHsmF0mOENXw_1aYBB5QJ821x1fnFAW-EhSP2u6Ub5mMJZ9Sm1YivOWdtd9Pyk-qWRztWlgyc_3WZoTnaVFqBRFu6BqQe3ZqYzr0os_S1OfYi9IGEEikQQl9oFc Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Domain-Id: None Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Domain-Name: None Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Identity-Status: Confirmed Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Is-Admin-Project: True Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Project-Domain-Id: default Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Project-Domain-Name: Default Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Project-Id: 77d99f4c9bdc47a48c41bcdeaf517d54 Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Project-Name: admin Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Role: member,reader,admin Jun 07 13:07:20.157773 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Roles: member,reader,admin Jun 07 13:07:20.159385 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_77d99f4c9bdc47a48c41bcdeaf517d54", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77d99f4c9bdc47a48c41bcdeaf517d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:07:20.159385 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Tenant: admin Jun 07 13:07:20.159385 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Tenant-Id: 77d99f4c9bdc47a48c41bcdeaf517d54 Jun 07 13:07:20.159385 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-Tenant-Name: admin Jun 07 13:07:20.159385 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-User: admin Jun 07 13:07:20.159385 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-User-Domain-Id: default Jun 07 13:07:20.159385 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-User-Domain-Name: Default Jun 07 13:07:20.159385 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-User-Id: 0d2d4d42368343ecbcecbcb439b6763e Jun 07 13:07:20.159385 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: X-User-Name: admin Jun 07 13:07:20.159385 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: method: > Jun 07 13:07:20.159385 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: exception: Flavor 451 could not be found. Jun 07 13:07:20.159385 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: action_args: {'id': '451'} Jun 07 13:07:20.159385 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:07:20.159385 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:07:20.160372 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: ERROR nova.api.openstack.wsgi Jun 07 13:07:20.162347 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-e1342bdb-e807-47be-99f3-3b0b3e519f63 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:07:20.163655 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-e1342bdb-e807-47be-99f3-3b0b3e519f63 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011723 Jun 07 13:07:20.163655 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 26/52] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Jun 7 13:07:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 13:07:21.016241 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-133518fd-f1ad-42ca-a29d-f7b7f93cc896 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:21.017247 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-133518fd-f1ad-42ca-a29d-f7b7f93cc896 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 07 13:07:21.017644 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 27/53] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jun 7 13:07:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:07:21.204082 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-85a7768e-fd26-4a05-8bea-87448159c5be admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:07:21.222141 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-85a7768e-fd26-4a05-8bea-87448159c5be admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069556 Jun 07 13:07:21.222721 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 27/54] 10.222.0.58 () {64 vars in 1235 bytes} [Tue Jun 7 13:07:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:07:22.094697 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-133518fd-f1ad-42ca-a29d-f7b7f93cc896 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:22.095697 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-133518fd-f1ad-42ca-a29d-f7b7f93cc896 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 07 13:07:22.096092 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 28/55] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jun 7 13:07:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:07:22.282993 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-2a524215-39a3-4b47-84e7-ef0b332c9413 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:07:22.301418 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-2a524215-39a3-4b47-84e7-ef0b332c9413 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069085 Jun 07 13:07:22.302602 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 28/56] 10.222.0.58 () {64 vars in 1235 bytes} [Tue Jun 7 13:07:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:07:23.167873 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-133518fd-f1ad-42ca-a29d-f7b7f93cc896 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:23.168873 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-133518fd-f1ad-42ca-a29d-f7b7f93cc896 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Jun 07 13:07:23.169278 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 29/57] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jun 7 13:07:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:07:23.356872 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-5b668f38-d4c6-4635-97cd-48c26311df68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:07:23.374147 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-5b668f38-d4c6-4635-97cd-48c26311df68 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068585 Jun 07 13:07:23.374731 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 29/58] 10.222.0.58 () {64 vars in 1235 bytes} [Tue Jun 7 13:07:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:07:24.244622 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-133518fd-f1ad-42ca-a29d-f7b7f93cc896 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:24.245617 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-133518fd-f1ad-42ca-a29d-f7b7f93cc896 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Jun 07 13:07:24.246010 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 30/59] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jun 7 13:07:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:07:24.434618 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-378911f2-cc2c-435f-9439-f4d5e87791fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:07:24.452069 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-378911f2-cc2c-435f-9439-f4d5e87791fb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068542 Jun 07 13:07:24.452616 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 30/60] 10.222.0.58 () {64 vars in 1235 bytes} [Tue Jun 7 13:07:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:07:25.316401 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-133518fd-f1ad-42ca-a29d-f7b7f93cc896 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:25.317867 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-133518fd-f1ad-42ca-a29d-f7b7f93cc896 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Jun 07 13:07:25.318266 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 31/61] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jun 7 13:07:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:07:25.502903 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-f3d44535-0888-40e3-9e94-cf11fa53b096 admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:07:25.522373 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-f3d44535-0888-40e3-9e94-cf11fa53b096 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070039 Jun 07 13:07:25.522944 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 31/62] 10.222.0.58 () {60 vars in 1202 bytes} [Tue Jun 7 13:07:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:08:26.387529 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-133518fd-f1ad-42ca-a29d-f7b7f93cc896 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:08:26.388532 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-133518fd-f1ad-42ca-a29d-f7b7f93cc896 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 07 13:08:26.388954 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 32/63] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jun 7 13:08:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:08:26.396308 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG dbcounter [-] [103396] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:08:26.449608 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-18d79c16-a3b5-4e7c-a07d-ad5a0488c5c1 admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:08:26.469429 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-18d79c16-a3b5-4e7c-a07d-ad5a0488c5c1 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074602 Jun 07 13:08:26.469960 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 32/64] 10.222.0.58 () {60 vars in 1291 bytes} [Tue Jun 7 13:08:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:08:26.490845 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG dbcounter [-] [103397] Writing DB stats nova_api:SELECT=14 {{(pid=103397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:08:26.494789 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-fa76ee46-c9f5-4c41-81e5-b3b73b2049a9 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:08:26.502226 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-fa76ee46-c9f5-4c41-81e5-b3b73b2049a9 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013496 Jun 07 13:08:26.502773 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 33/65] 10.222.0.58 () {60 vars in 1282 bytes} [Tue Jun 7 13:08:26 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:08:26.514568 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-c6a3437b-3642-4456-b77c-cfa4a6306282 admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:08:26.522405 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-c6a3437b-3642-4456-b77c-cfa4a6306282 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011405 Jun 07 13:08:26.522943 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 33/66] 10.222.0.58 () {60 vars in 1285 bytes} [Tue Jun 7 13:08:26 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:08:26.533764 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-18eadc03-53af-4994-a95f-a090bdaab2e1 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:08:26.540963 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-18eadc03-53af-4994-a95f-a090bdaab2e1 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010624 Jun 07 13:08:26.541478 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 34/67] 10.222.0.58 () {60 vars in 1285 bytes} [Tue Jun 7 13:08:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:08:26.553275 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-ce21234e-ada9-4928-87fb-de4d473cc6e5 admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:08:26.561119 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-ce21234e-ada9-4928-87fb-de4d473cc6e5 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011948 Jun 07 13:08:26.561645 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 34/68] 10.222.0.58 () {60 vars in 1282 bytes} [Tue Jun 7 13:08:26 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:11:41.672079 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-18eadc03-53af-4994-a95f-a090bdaab2e1 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:41.673113 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-18eadc03-53af-4994-a95f-a090bdaab2e1 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 07 13:11:41.673558 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 35/69] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jun 7 13:11:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:11:41.831958 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG dbcounter [-] [103396] Writing DB stats nova_api:SELECT=6 {{(pid=103396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:41.943996 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-461acace-ad0d-4860-b70a-2bf67eb2eaba admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:41.945156 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:11:41.945156 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: warnings.warn(msg) Jun 07 13:11:41.946353 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-461acace-ad0d-4860-b70a-2bf67eb2eaba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:41.946822 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-461acace-ad0d-4860-b70a-2bf67eb2eaba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:41.947609 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-461acace-ad0d-4860-b70a-2bf67eb2eaba admin admin] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:41.948064 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-461acace-ad0d-4860-b70a-2bf67eb2eaba admin admin] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:41.980689 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-461acace-ad0d-4860-b70a-2bf67eb2eaba admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.151078 Jun 07 13:11:41.981238 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 35/70] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Jun 7 13:11:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:11:42.854135 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-18eadc03-53af-4994-a95f-a090bdaab2e1 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:42.855180 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-18eadc03-53af-4994-a95f-a090bdaab2e1 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 07 13:11:42.855579 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 36/71] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jun 7 13:11:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:11:43.048915 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-16679dd5-dbc5-48bf-b5a9-ff26dd7460ab admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:43.050085 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:11:43.050085 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: warnings.warn(msg) Jun 07 13:11:43.051299 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-16679dd5-dbc5-48bf-b5a9-ff26dd7460ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:43.051745 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-16679dd5-dbc5-48bf-b5a9-ff26dd7460ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:43.052534 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-16679dd5-dbc5-48bf-b5a9-ff26dd7460ab admin admin] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:43.052964 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-16679dd5-dbc5-48bf-b5a9-ff26dd7460ab admin admin] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:43.072670 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-16679dd5-dbc5-48bf-b5a9-ff26dd7460ab admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076844 Jun 07 13:11:43.073153 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 36/72] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Jun 7 13:11:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:11:54.390202 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-18eadc03-53af-4994-a95f-a090bdaab2e1 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:54.391233 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-18eadc03-53af-4994-a95f-a090bdaab2e1 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 07 13:11:54.391632 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 37/73] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jun 7 13:11:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:11:54.532554 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG dbcounter [-] [103396] Writing DB stats nova_cell0:SELECT=4 {{(pid=103396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:54.533196 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG dbcounter [-] [103396] Writing DB stats nova_cell1:SELECT=4 {{(pid=103396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:54.533922 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG dbcounter [-] [103396] Writing DB stats nova_api:SELECT=8 {{(pid=103396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:54.582088 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-003b3a71-7d6f-43ec-a285-2b050ee236f3 admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:54.583325 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:11:54.583325 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: warnings.warn(msg) Jun 07 13:11:54.584514 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-003b3a71-7d6f-43ec-a285-2b050ee236f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:54.584957 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-003b3a71-7d6f-43ec-a285-2b050ee236f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:54.585765 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-003b3a71-7d6f-43ec-a285-2b050ee236f3 admin admin] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:54.586198 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-003b3a71-7d6f-43ec-a285-2b050ee236f3 admin admin] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:54.610680 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-003b3a71-7d6f-43ec-a285-2b050ee236f3 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082615 Jun 07 13:11:54.611228 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 37/74] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Jun 7 13:11:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:11:55.493060 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: DEBUG nova.api.openstack.wsgi [None req-18eadc03-53af-4994-a95f-a090bdaab2e1 admin admin] Calling method '>' {{(pid=103397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:55.494124 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: INFO nova.api.openstack.requestlog [None req-18eadc03-53af-4994-a95f-a090bdaab2e1 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 07 13:11:55.494552 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: [pid: 103397|app: 0|req: 38/75] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jun 7 13:11:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:11:55.684005 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG nova.api.openstack.wsgi [None req-e9adbc02-c707-4ef7-b59f-04159fec5873 admin admin] Calling method '>' {{(pid=103396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:55.685194 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:11:55.685194 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: warnings.warn(msg) Jun 07 13:11:55.686417 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-e9adbc02-c707-4ef7-b59f-04159fec5873 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:55.686890 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-e9adbc02-c707-4ef7-b59f-04159fec5873 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:55.687678 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-e9adbc02-c707-4ef7-b59f-04159fec5873 admin admin] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:55.688109 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: DEBUG oslo_concurrency.lockutils [None req-e9adbc02-c707-4ef7-b59f-04159fec5873 admin admin] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:55.710840 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: INFO nova.api.openstack.requestlog [None req-e9adbc02-c707-4ef7-b59f-04159fec5873 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077789 Jun 07 13:11:55.711315 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: [pid: 103396|app: 0|req: 38/76] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Jun 7 13:11:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:12:53.831443 dv-cinder-844964-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 07 13:12:53.832605 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: Tue Jun 7 13:12:53 2022 - graceful shutdown triggered... Jun 07 13:12:53.833522 dv-cinder-844964-1-iscsi devstack@n-api.service[103396]: Gracefully killing worker 1 (pid: 103396)... Jun 07 13:12:53.833885 dv-cinder-844964-1-iscsi devstack@n-api.service[103397]: Gracefully killing worker 2 (pid: 103397)... Jun 07 13:12:54.833157 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: worker 1 buried after 1 seconds Jun 07 13:12:54.833586 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: worker 2 buried after 1 seconds Jun 07 13:12:54.833586 dv-cinder-844964-1-iscsi devstack@n-api.service[103393]: goodbye to uWSGI. Jun 07 13:12:54.834762 dv-cinder-844964-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 07 13:12:54.835332 dv-cinder-844964-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 07 13:12:54.838195 dv-cinder-844964-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 13:12:54.860231 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 13:12:54.879612 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 13:12:54 2022] *** Jun 07 13:12:54.879612 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 13:12:54.879612 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 13:12:54.879612 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: nodename: dv-cinder-844964-1-iscsi Jun 07 13:12:54.879612 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: machine: x86_64 Jun 07 13:12:54.879612 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: clock source: unix Jun 07 13:12:54.879612 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: pcre jit disabled Jun 07 13:12:54.879612 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: detected number of CPU cores: 4 Jun 07 13:12:54.879612 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: current working directory: / Jun 07 13:12:54.879612 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: detected binary path: /usr/bin/uwsgi-core Jun 07 13:12:54.880403 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: your processes number limit is 47680 Jun 07 13:12:54.880403 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: your memory page size is 4096 bytes Jun 07 13:12:54.880403 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: detected max file descriptor number: 2048 Jun 07 13:12:54.880403 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: lock engine: pthread robust mutexes Jun 07 13:12:54.880403 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: thunder lock: enabled Jun 07 13:12:54.880403 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 13:12:54.880403 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 13:12:54.931308 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: Python main interpreter initialized at 0x55578fcb19c0 Jun 07 13:12:54.931308 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: python threads support enabled Jun 07 13:12:54.931308 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: your server socket listen backlog is limited to 100 connections Jun 07 13:12:54.931308 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: your mercy for graceful operations on workers is 90 seconds Jun 07 13:12:54.931756 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 13:12:54.931756 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: *** Operational MODE: preforking *** Jun 07 13:12:54.932027 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: *** uWSGI is running in multiple interpreter mode *** Jun 07 13:12:54.932027 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: spawned uWSGI master process (pid: 117778) Jun 07 13:12:54.932235 dv-cinder-844964-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 13:12:54.933004 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: spawned uWSGI worker 1 (pid: 117797, cores: 1) Jun 07 13:12:54.934475 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: spawned uWSGI worker 2 (pid: 117798, cores: 1) Jun 07 13:12:54.934475 dv-cinder-844964-1-iscsi devstack@n-api.service[117778]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 13:12:56.168186 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 13:12:56.178558 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 13:12:57.004435 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:12:57.004435 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: from cryptography.utils import int_from_bytes Jun 07 13:12:57.004774 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:12:57.004774 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: from cryptography.utils import int_from_bytes Jun 07 13:12:57.010400 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:12:57.010400 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: from cryptography.utils import int_from_bytes Jun 07 13:12:57.010765 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:12:57.010765 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: from cryptography.utils import int_from_bytes Jun 07 13:12:59.346812 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 13:12:59.347353 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 13:12:59.347589 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 13:12:59.347953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 13:12:59.348049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 13:12:59.348412 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 13:12:59.348517 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 13:12:59.348603 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.348830 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 13:12:59.348932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.349195 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 13:12:59.349288 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.349452 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 13:12:59.349545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.349838 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.349937 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.350149 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.350252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.350484 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.350594 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.350809 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.350910 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.351141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.351249 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.351402 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.351538 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.351717 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.351860 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.352044 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844964-1-iscsi {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.352195 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.352368 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.352498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.352633 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.352770 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.352911 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.353046 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.353236 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844964-1-iscsi {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.353379 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.353555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.353687 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.353858 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.353991 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.354158 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.354297 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.354493 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.354693 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.354874 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.355105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.355281 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.355428 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.355581 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.355771 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.355930 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.356296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.356534 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.356755 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.356963 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.357192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.357423 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.357635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.357855 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.358083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.358307 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.358564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.358795 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.359005 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.359215 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.359435 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844964-1-iscsi {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.359644 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.359851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.360070 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.360300 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.360526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.360747 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.361623 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844964-1-iscsi {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.361623 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.362083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.362273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.362494 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.362662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.362857 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.362857 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.363154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.363309 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.363500 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.363500 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.363799 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.363943 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.364093 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.364244 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.364397 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.364542 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.364685 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.364958 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.365126 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.365288 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.365444 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.365601 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.365753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.365904 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.366058 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.366215 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.367418 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.367510 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.367846 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.367938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.368021 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.368113 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.368188 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.368267 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.368340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.368418 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.368503 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.368586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.368658 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.368991 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.369096 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.369196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.369306 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.369387 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.369466 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.369539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.369611 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.369696 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.369769 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.369840 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.369918 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.369999 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.370078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.370159 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.370238 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.370309 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.370387 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.370493 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.370593 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.370675 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.370748 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.370825 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.370903 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.370986 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.371072 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.371151 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.371222 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.371299 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.371402 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.371511 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.371601 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.371696 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.371772 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.371843 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.371912 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.371982 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.372061 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.372144 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.372216 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.372294 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.372366 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.372436 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.372550 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.373222 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.373395 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.373544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.373687 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.373843 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.373987 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.374139 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.374280 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.374428 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.374605 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.374814 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.375058 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.375212 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.375362 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.375505 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.375652 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.375806 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.375947 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.376089 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.376229 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.376376 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.376579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.377232 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.377402 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.377547 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.377691 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.377834 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.377986 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.378139 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.378283 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.378426 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.378622 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.378775 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.378929 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.379080 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.379233 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.379395 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.379575 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.379721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.379874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.380018 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.380161 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.380312 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.380455 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.380606 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.380759 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.380903 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.381054 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.381198 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.381361 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.381521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.381717 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.381956 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.382115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.382267 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.382420 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.382607 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.382607 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.382889 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.382889 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.383170 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.383320 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.383488 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.383488 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.383770 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.383914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.384065 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.384209 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.384361 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.384515 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.384667 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.384820 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.384964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.385196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.385368 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.385533 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.385678 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.385828 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.385983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.386134 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.386290 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.386434 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.386704 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.386860 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.387013 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.387172 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.387325 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.387479 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.387632 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.387812 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.387970 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.388129 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.388281 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.388433 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.388585 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.388738 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.388882 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.389034 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.389179 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.389329 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.389496 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.389642 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.389794 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.389953 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.390098 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.390248 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.390402 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.390583 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.390738 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.390897 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.391041 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.391185 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.391336 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.391497 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.391659 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.391819 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.391988 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.392170 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.392320 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.392471 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.392624 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.392776 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.392927 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.393079 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.393231 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.393375 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:12:59.393544 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.393696 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.393849 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.394001 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.394145 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.394297 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.394472 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.394626 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.394782 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.394927 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.395085 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.395325 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.395487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.395643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.395788 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.395932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.396077 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.396234 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.396378 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.396521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.396665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.396808 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.396961 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.397114 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.397258 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.397418 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.397563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.397706 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.397867 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.398024 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.398183 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.398336 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.398510 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.398667 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.398813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.398973 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.399125 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.399287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.399431 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.399583 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.399733 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.399887 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.400040 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.400186 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.400330 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.400472 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.400623 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.400848 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.400848 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.401133 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.401133 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.401428 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.401589 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.401747 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.401898 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.402050 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.402194 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.402347 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.402557 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.402716 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.402861 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.403015 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.403015 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.403307 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.403466 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.403617 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.403762 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.403913 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.404065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.404209 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.404365 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.404544 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.404702 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.404855 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.405011 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.405163 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.405345 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.405559 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.405707 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.405851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.406006 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.406159 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.406311 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.406475 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.406627 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.406780 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.406925 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.407078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.407233 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.407376 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.407528 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.407680 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.407859 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.408018 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.408170 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.408321 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.408464 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.408608 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.408759 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.408917 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.409069 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.409223 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.409366 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.409518 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.409671 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.409829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.409974 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.410118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.410268 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.410419 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.410604 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.410752 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.410895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.411038 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.411204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.411348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.411512 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.411660 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.411805 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.411949 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.412099 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.412250 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.412412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.412564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.412708 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.412859 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.413003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.413157 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.413314 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.413457 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.413874 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.414029 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.414173 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.414325 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.414579 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.414732 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.414886 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.415031 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.415174 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.415341 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.415493 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.415720 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.415871 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.416015 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.416158 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.416315 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.416461 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.416604 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.416754 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.416897 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.417049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.417207 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.417370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.417515 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.417666 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.417810 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.417962 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.418108 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.418251 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.418395 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.418580 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.418726 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.418883 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.419028 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.419178 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.419333 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.419483 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.419627 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.419782 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.419961 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.420121 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.420272 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.420422 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.420573 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.420725 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.420870 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.421013 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.421163 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.421440 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.421647 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.421807 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.421959 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.422111 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.422257 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.422411 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.422600 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.422746 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.422890 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.423042 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.423199 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.423866 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.424040 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.424193 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.424345 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.424490 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.424640 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.424791 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.424950 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.425102 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.425246 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.425390 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.425390 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.425676 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.425916 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.426066 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.426211 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.426362 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.426535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.426695 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.426841 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.426985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.427136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.427281 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.427425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.427581 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.427734 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.427889 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.428034 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.428177 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.428328 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.428486 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.428631 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.428788 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.428941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.429086 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.429238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.429389 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.429544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.429689 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.429852 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.430005 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.430230 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.430384 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.430611 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.430759 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.430902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.431053 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.431211 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.431355 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.431499 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.431643 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.431794 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.431957 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.432114 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.432258 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.432402 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.432545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.432689 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.432840 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.432997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.433142 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.433285 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.433436 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.433580 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.433747 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.433907 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.434058 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.434210 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.434354 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.434534 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.434698 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.434851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.434996 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.435140 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.435291 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.435443 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.435600 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.435762 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.435928 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.436139 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.436288 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.436432 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.436585 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.436738 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.436892 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.437036 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.437186 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.437340 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.437484 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.437627 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.437788 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.437934 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.438077 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.438234 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.438378 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.438564 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.438718 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.438864 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.439063 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.439720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.439873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.440032 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.440183 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.440344 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.440493 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.440657 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.440808 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.440958 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.441108 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.441258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.441422 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.441574 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.441731 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.441882 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.442042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.442202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.442386 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.442609 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.442763 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.442913 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.443061 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.443213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.443372 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.443531 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.443689 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.443847 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.443998 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.444155 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.444330 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.444489 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.444640 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.444799 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.444957 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.445116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.445275 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.445434 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.445584 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.445735 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.445884 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.446048 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.446293 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.446478 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.446646 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.446805 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.446965 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.447130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.447282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.447442 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.447600 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.447758 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.447908 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.448068 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.448219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.448371 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.448531 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.448689 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.448842 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.449002 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.449154 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.449313 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.449473 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.449625 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.449784 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.449936 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.450096 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.450248 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.450398 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.450595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.450763 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.450924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.451074 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.451225 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.451382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.451542 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.451542 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.451843 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.452007 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.452169 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.452320 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.452470 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.452641 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.452792 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.452948 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.453098 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.453248 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.453407 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.453566 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.453724 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.453876 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.454025 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.454182 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.454341 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.454537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.454721 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.454873 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.455041 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.455206 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.455413 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.455566 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.455725 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.455725 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.456023 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.456023 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.456414 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.456573 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.456735 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.456895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.457054 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.457219 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.457372 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.457523 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.457673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.457824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.457974 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.458138 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.458290 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.458488 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.458658 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.458821 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.458981 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.459141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.459311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.459470 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.459621 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.459782 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.459935 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.460085 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.460315 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.460476 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.460628 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.460796 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.460947 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.461107 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.461267 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.461425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.461576 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.461727 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.461884 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.462056 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.462209 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.462359 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.462532 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.462697 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.462860 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.463020 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.463179 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.463338 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.463497 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.463648 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.463806 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.463966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.464126 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.464285 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.464444 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.464594 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.464754 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.464919 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.465077 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.465236 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.465387 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.465544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.465705 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.465864 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.466023 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.466174 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.466326 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.466617 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.466792 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.466953 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.467122 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.467276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.467434 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.467593 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.467823 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.467984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.468143 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.468296 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.468446 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.468610 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.468762 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.468913 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.469074 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.469225 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.469385 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.469551 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.469709 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.469869 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.470020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.470178 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.470868 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.471036 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.471196 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.471355 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.471507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.471669 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.471827 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.471996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.472148 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.472299 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.472466 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.472622 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.472782 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.472933 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.473083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.473233 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.473391 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.473543 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.473716 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.473868 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.474017 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.474167 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.474324 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.474525 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.474695 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.474847 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.475006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.475158 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.475314 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.475472 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.475636 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.475805 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.475965 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.476122 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.476282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.476442 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.476619 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.476849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.477005 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.477155 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.477314 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.477475 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.477626 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.477797 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.477948 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.478105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.478264 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.478427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.478611 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.478762 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.478913 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.479063 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.479213 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.479376 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.479528 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.479685 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.479847 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.479998 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.480162 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.480321 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.480479 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.480638 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.480795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.480947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.481112 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.481264 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.481422 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.481572 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.481722 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.481882 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.482045 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.482196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.482353 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.482554 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.482554 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.482855 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.483021 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.483173 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.483330 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.483488 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.483648 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.483812 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.483981 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.484134 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.484284 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.484434 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.484584 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.484747 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.484906 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.485064 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.485223 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.485374 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.485523 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.485682 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.485832 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.486548 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.486719 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.486959 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.487125 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.487292 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.487451 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.487610 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.487610 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.487897 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.487897 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.488200 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.488358 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.488527 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.488685 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.488837 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.488997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.489148 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.489300 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.489450 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.489600 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.489757 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.489916 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.490067 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.490217 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.490374 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.490576 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.490737 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.490903 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.491061 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.491219 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.491371 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.491521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.491671 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.491831 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.491981 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.492132 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.492290 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.492442 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.492629 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.492781 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.492931 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.493082 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.493241 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.493392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.493577 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.493741 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.493900 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.494058 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.494210 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.494367 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.494565 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.494729 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.494880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.495031 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.495189 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.495347 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.495507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.495667 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.495825 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.495976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.496133 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.496294 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.496444 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.496595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.496764 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.496933 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.497032 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.497130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.497219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.497294 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.497411 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.497485 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.497557 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.497746 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.497833 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.497915 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.497996 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.498076 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.498156 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.498239 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.498319 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.498430 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.498621 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.498708 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.498797 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.498870 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.498941 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.499011 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.499081 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.499164 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.499253 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.499333 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.499406 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.499476 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.499554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.499626 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.499705 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.499785 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.499864 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.499943 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.500022 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.500094 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.500175 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.500247 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.500318 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.500396 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.500468 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.500553 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.500626 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.500704 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.500805 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.500887 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.500960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.501039 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.501136 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.501221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.501294 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.501364 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.501434 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.501519 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.501600 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.501673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.501751 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.501823 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.501895 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.501975 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.502048 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.502129 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.502209 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.502291 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.502372 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.502470 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.502548 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.502619 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.502702 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.502775 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.502880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.502962 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.503042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.503122 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.503212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.503295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.503378 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.503451 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.503531 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.503602 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.503763 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.503892 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.504070 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.504178 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.504381 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.504486 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.504707 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.504813 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.505033 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.505138 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.505354 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.505463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.505659 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.505762 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.505974 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.506071 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.506281 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.506385 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.506617 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.506715 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.506919 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.507024 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.507238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.507351 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.507554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.507654 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.507861 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.507962 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.508177 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.508281 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.508499 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.508643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.508815 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.508909 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.509141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.509248 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.509499 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.509599 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.509823 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.509917 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.510128 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.510223 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.510430 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.510555 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.510761 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.510867 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.511066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.511172 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.511371 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.511475 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.511691 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.511794 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.511994 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.512089 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.512307 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.512400 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.512619 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.512712 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.512925 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.513036 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.513225 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.513320 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.513528 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.513693 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.513898 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.514038 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.514177 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.514268 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.514433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.514564 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.514778 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.514871 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.515084 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.515184 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.515407 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.515514 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.515711 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.515813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.516032 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.516125 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.516341 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.516444 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.516645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.516739 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.516951 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.517044 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.517283 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.517378 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.517600 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.517693 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.517910 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.518043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.518221 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.518317 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.518572 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.518719 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.518889 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.518984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.519193 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.519288 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.519526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.519621 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.519849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.519950 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.520161 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.520263 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.520472 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.520572 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.520796 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.520904 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.521098 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.521201 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.521400 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.521504 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.521709 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.521818 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.522013 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.522107 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.522314 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.522408 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.522641 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.522747 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.522946 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.523047 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.523244 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.523345 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.523543 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.523648 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.523844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.523953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.524155 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.524304 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.524450 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.524546 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.524754 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.524849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.525058 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.525151 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.525360 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.525455 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.525660 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.525755 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.525962 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.526065 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.526271 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.526364 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.526603 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.526701 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.526910 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.527014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.527236 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.527330 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.527548 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.527648 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.527872 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.527976 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.528180 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.528284 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.528501 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.528594 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.528813 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.528914 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.529128 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.529230 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.529442 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.529544 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.529755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.529859 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.530069 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.530164 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.530384 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.530510 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.530719 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.530826 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.531027 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.531121 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.531343 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.531443 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.531656 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.531759 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.531966 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.532066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.532291 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.532480 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.532609 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.533329 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.533455 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.533645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.533958 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.534052 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.534279 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.534425 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.534601 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.534709 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.534914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.535008 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.535224 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.535431 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.535537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.535632 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.535829 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.535937 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.536136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.536232 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.536449 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.536542 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.536763 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.536867 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.537077 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.537179 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.537406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.537499 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.537718 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.537826 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.538030 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.538125 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.538341 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.538468 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.538946 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.539056 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.539274 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.539366 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.539594 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.539699 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.539896 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.540006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.540205 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.540301 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.540518 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.540627 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.540830 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.540941 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.541141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.541243 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.541450 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.541562 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.541763 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.541866 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.542071 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.542172 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.542380 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.542571 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.542719 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.542815 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.543030 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.543133 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.543363 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.543467 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.543642 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.543737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.543957 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.544106 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.544275 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.544393 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.544587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.544702 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.544897 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.545007 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.545210 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.545319 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.545538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.545726 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.545856 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.546043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.546174 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.546375 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.546723 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.546819 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.547045 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.547152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.547377 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.547511 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.547673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.547770 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.547999 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.548162 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.548305 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.548390 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.549143 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.549254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.549454 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.549563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.549762 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.549864 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.550065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.550160 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.550380 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.550496 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.550713 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.550822 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.551016 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.551110 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.551332 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.551435 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.551639 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.551734 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.551944 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.552167 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.552283 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.552511 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.552606 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.552829 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.553094 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.553199 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.553444 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.553539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.553763 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.553858 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.554067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.554221 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.554390 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.554525 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.554753 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.554848 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.555012 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.555121 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.555326 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.555430 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.555634 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.555729 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.555936 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.556044 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.556240 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.556334 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.556550 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.556653 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.556858 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.556952 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.557160 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.557253 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.557468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.557563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.557771 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.557873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.558077 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.558184 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.558396 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.558618 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.558717 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.558928 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.559024 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.559233 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.559327 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.559547 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.559651 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.559852 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.559948 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.560154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.560256 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.560460 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.560555 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.560762 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.560864 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.561070 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.561165 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.561372 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.561467 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.561680 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.561812 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.561982 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.562110 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.563378 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.563715 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.564054 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.564282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.564404 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.564525 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.564525 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.564775 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.564972 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.565099 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.565099 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.565331 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.565445 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.565558 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.565670 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.565811 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.565942 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.566070 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.566192 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.566313 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.566313 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.566313 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.566313 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.566785 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.566906 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.567039 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.567154 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.567267 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.567386 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.567510 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.567624 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.567794 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.567917 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.568156 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.568296 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.568450 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.568573 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.568785 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.568930 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.569098 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.569248 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.569408 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.569551 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.569716 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.569851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.570024 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.570176 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.570342 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.570536 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.570714 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.570864 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.570987 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.571111 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.571279 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.571415 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.571589 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.571722 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.571896 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.572029 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.572206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.572346 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.572521 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.572651 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.572844 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.572978 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.573117 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.573258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.573429 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.573565 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.573738 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.573881 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.574049 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.574184 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.574366 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.574532 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.574705 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.574839 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.575063 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.575206 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.575349 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.575490 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.575663 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.575800 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.575978 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.576113 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.576289 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.576440 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.576579 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.576710 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.576889 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.577024 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.577199 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.577332 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.577506 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.577650 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.577821 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.577957 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.578139 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.578356 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.578526 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.578653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.578765 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.578877 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.579173 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.579311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.579487 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.579637 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.579835 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.579986 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.580146 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.580288 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.580454 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.580597 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.580775 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.580926 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.581088 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.581222 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.581395 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.581529 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.581710 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.581851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.582018 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.582149 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.582345 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.582521 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.582711 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.582856 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.583036 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.583169 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.583343 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.583478 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.583651 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.583787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.583958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.584097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.584410 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.584576 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.584682 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.584820 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.584923 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.585024 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.585172 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.585471 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.585591 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.585779 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.585877 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.586087 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.586190 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.586392 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.586500 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.586722 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.586879 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.587029 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.587281 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.587390 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.587626 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.587724 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.587928 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.588057 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.588233 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.588392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.588595 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.588745 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.588878 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.589010 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.589148 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.589300 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.589442 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.589565 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.589696 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.589834 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.590064 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.590243 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.590374 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.590561 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.590865 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.591551 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.591662 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.591809 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.591901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.591996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.592091 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.592192 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.592287 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.592374 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.592460 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.592546 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.592641 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.592772 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.592867 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.593090 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.593193 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.593414 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.593516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.593727 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.593868 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.594048 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.594145 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.594358 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.594487 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.594704 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.594798 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.595027 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.595124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.595867 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.596034 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.596170 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.596310 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.596482 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.596584 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.596794 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.596961 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.597094 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.597224 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.597402 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.597547 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.597712 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.597819 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.598021 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.598159 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.598330 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.598525 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.598751 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.598890 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.599022 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.599157 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.599300 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.599434 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.599581 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.599673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.599882 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.599978 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.600199 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.600301 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.600510 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.600674 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.600819 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.600969 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.601129 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.601235 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.601443 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.601546 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.601754 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.601848 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.602069 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.602248 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.602380 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.602507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.602714 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.602809 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.603028 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.603132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.603349 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.603496 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.603676 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.603771 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.604000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.604094 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.604307 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.604401 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.604633 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.604727 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.604958 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.605061 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.605279 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.605380 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.605598 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.605725 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.605964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.606116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.606248 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 13:12:59.606389 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.606578 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.606891 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.607193 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:12:59.607436 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 13:12:59.666770 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO dbcounter [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] Registered counter for database nova_api Jun 07 13:12:59.668892 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO dbcounter [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] Registered counter for database nova_api Jun 07 13:12:59.687501 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_db.sqlalchemy.engines [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:12:59.689277 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_db.sqlalchemy.engines [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:12:59.694343 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writer thread running {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:12:59.695747 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writer thread running {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:12:59.750952 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.context [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ea3ea752-fefa-4f40-8c99-d2fb2240d3ce(cell1) {{(pid=117798) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 13:12:59.751574 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.context [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ea3ea752-fefa-4f40-8c99-d2fb2240d3ce(cell1) {{(pid=117797) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 13:12:59.755154 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:59.755668 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:59.756730 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:59.757232 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:59.757545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:59.758041 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:59.759745 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:59.760022 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:59.761739 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO dbcounter [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] Registered counter for database nova_cell0 Jun 07 13:12:59.762003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO dbcounter [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] Registered counter for database nova_cell0 Jun 07 13:12:59.767535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO dbcounter [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] Registered counter for database nova_cell1 Jun 07 13:12:59.767682 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO dbcounter [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] Registered counter for database nova_cell1 Jun 07 13:12:59.775221 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_db.sqlalchemy.engines [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:12:59.776925 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_db.sqlalchemy.engines [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:12:59.778397 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_db.sqlalchemy.engines [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:12:59.780737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_db.sqlalchemy.engines [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:12:59.782265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writer thread running {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:12:59.785386 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writer thread running {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:12:59.787617 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writer thread running {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:12:59.926134 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writer thread running {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:12:59.935891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO dbcounter [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] Registered counter for database nova_cell0 Jun 07 13:12:59.936890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO dbcounter [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] Registered counter for database nova_cell0 Jun 07 13:12:59.943057 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_db.sqlalchemy.engines [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:12:59.944585 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_db.sqlalchemy.engines [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:12:59.947933 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writer thread running {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:12:59.949082 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writer thread running {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:13:00.384811 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: WARNING keystonemiddleware.auth_token [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:13:00.389062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: WARNING keystonemiddleware.auth_token [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:13:00.392113 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: WARNING keystonemiddleware.auth_token [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:13:00.396466 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: WARNING keystonemiddleware.auth_token [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:13:00.613619 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: WARNING keystonemiddleware.auth_token [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:13:00.619435 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: WARNING keystonemiddleware.auth_token [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:13:00.619903 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: WARNING keystonemiddleware.auth_token [None req-e9b89459-555d-4229-bc31-097b5c55a7b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:13:00.625432 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: WARNING keystonemiddleware.auth_token [None req-55028891-ab22-4e52-af33-bf25d7827d86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:13:00.625554 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55578fcb19c0 pid: 117797 (default app) Jun 07 13:13:00.630563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55578fcb19c0 pid: 117798 (default app) Jun 07 13:13:41.608514 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=3 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:41.610124 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=3 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:41.611101 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=3 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:41.612243 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=3 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:42.031032 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:42.033491 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:42.034702 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:42.035501 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:42.860916 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9437d739-d2cd-4683-ba2f-bb8abb768d24 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] Action: 'create', calling method: .version_select at 0x7fb8f5e555e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1630112644", "metadata": {"Type": "work"}}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:43.063479 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a83eaa42-68a1-46d7-abcd-bc2259800c77 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Action: 'create', calling method: .version_select at 0x7fb8f5e565e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1066926877"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:44.190788 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9437d739-d2cd-4683-ba2f-bb8abb768d24 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.587516 Jun 07 13:13:44.192095 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1155 bytes} [Tue Jun 7 13:13:41 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2590 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 07 13:13:44.204801 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8e898bb2-9cc4-4266-a1b0-a855e2c2ebd9 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] Calling method '.version_select at 0x7fb8f5d215e0>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:44.365080 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8e898bb2-9cc4-4266-a1b0-a855e2c2ebd9 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0" status: 200 len: 353 microversion: 2.1 time: 0.164218 Jun 07 13:13:44.365917 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 2/2] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:44 2022] GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0 => generated 353 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:13:45.292848 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a83eaa42-68a1-46d7-abcd-bc2259800c77 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.266854 Jun 07 13:13:45.300541 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1154 bytes} [Tue Jun 7 13:13:42 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3270 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 07 13:13:45.306245 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0c01e72c-50db-4f46-a242-eef654036e84 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f5d21700>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:45.378012 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-51ce5836-2746-4404-9200-14d0cc7f9027 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] Calling method '.version_select at 0x7fb8f5d215e0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:45.423118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0c01e72c-50db-4f46-a242-eef654036e84 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601" status: 200 len: 345 microversion: 2.1 time: 0.121494 Jun 07 13:13:45.423941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 3/4] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:45 2022] GET /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601 => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:45.470917 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-51ce5836-2746-4404-9200-14d0cc7f9027 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0" status: 200 len: 353 microversion: 2.1 time: 0.097397 Jun 07 13:13:45.476475 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 2/5] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:45 2022] GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:13:46.110477 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d603bffb-5d77-4f1d-bece-7a703281adf6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1217490436", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452", "networks": [{"uuid": "8c04fdae-949e-4c11-a13e-c9d74fb7c110"}]}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:46.312668 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.network.neutron [None req-d603bffb-5d77-4f1d-bece-7a703281adf6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] validate_networks() for [('8c04fdae-949e-4c11-a13e-c9d74fb7c110', None, None, None, None, None)] {{(pid=117797) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:13:46.435737 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-db93ca83-b9fb-4bc0-a5d8-99261ae3aab2 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f5d21940>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:46.495222 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-db93ca83-b9fb-4bc0-a5d8-99261ae3aab2 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601" status: 200 len: 346 microversion: 2.1 time: 0.063218 Jun 07 13:13:46.495791 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 3/6] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:46 2022] GET /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601 => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:13:46.506863 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9cd7ccdd-186c-4631-aa3c-f5b2893935a7 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] Calling method '.version_select at 0x7fb8f5d21dc0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:46.621080 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9cd7ccdd-186c-4631-aa3c-f5b2893935a7 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0" status: 200 len: 354 microversion: 2.1 time: 0.117821 Jun 07 13:13:46.622290 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:46 2022] GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0 => generated 354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:46.627751 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1bd323b2-6b55-47a4-90da-0bfc1f0d52d3 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Action: 'create', calling method: .version_select at 0x7fb8f5d32430>, body: {"snapshot": {"volume_id": "71984b86-4fd8-46db-92ad-7a081b0f8601", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1033221201"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:46.986863 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1bd323b2-6b55-47a4-90da-0bfc1f0d52d3 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.363328 Jun 07 13:13:46.988397 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 5/8] 10.222.0.58 () {60 vars in 1161 bytes} [Tue Jun 7 13:13:46 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:46.993984 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7a5b8b46-999f-48b1-b330-565cd0d98b68 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] Calling method '.version_select at 0x7fb8f5d21d30>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:47.084756 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7a5b8b46-999f-48b1-b330-565cd0d98b68 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0" status: 200 len: 354 microversion: 2.1 time: 0.094957 Jun 07 13:13:47.086247 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 6/9] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:46 2022] GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:47.109950 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-65add597-2cd5-4767-b11f-3b3f9a54f944 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f5d21c10>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:47.158010 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-65add597-2cd5-4767-b11f-3b3f9a54f944 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367" status: 200 len: 287 microversion: 2.1 time: 0.055608 Jun 07 13:13:47.164396 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 7/10] 10.222.0.58 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:47 2022] GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:47.168337 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2367c331-d96a-4219-93e7-3a7c9a9ea6c9 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] Calling method '.version_select at 0x7fb8f5d32940>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:47.315962 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2367c331-d96a-4219-93e7-3a7c9a9ea6c9 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0" status: 202 len: 0 microversion: 2.1 time: 0.154885 Jun 07 13:13:47.316914 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 8/11] 10.222.0.58 () {58 vars in 1247 bytes} [Tue Jun 7 13:13:47 2022] DELETE /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:13:47.325168 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6e967d61-a087-46af-b537-0d2b26e455eb tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f5d21c10>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:47.409489 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6e967d61-a087-46af-b537-0d2b26e455eb tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.088213 Jun 07 13:13:47.410274 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 9/12] 10.222.0.58 () {58 vars in 1139 bytes} [Tue Jun 7 13:13:47 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:47.418429 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b70c63f0-7806-4a3d-89bb-b7d6845d518b tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] Calling method '.version_select at 0x7fb8f5d32820>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:47.512877 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b70c63f0-7806-4a3d-89bb-b7d6845d518b tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0" status: 200 len: 353 microversion: 2.1 time: 0.099214 Jun 07 13:13:47.513471 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 10/13] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:47 2022] GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0 => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:47.525789 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-16b6428a-0439-48d7-b5e2-bb8bb2d63943 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f5d32160>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:47.568443 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-16b6428a-0439-48d7-b5e2-bb8bb2d63943 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367" status: 200 len: 287 microversion: 2.1 time: 0.048136 Jun 07 13:13:47.572498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 11/14] 10.222.0.58 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:47 2022] GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:48.528580 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-08436d8a-0f90-46a4-91af-02330f788e76 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] Calling method '.version_select at 0x7fb8f5d320d0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:48.617134 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-08436d8a-0f90-46a4-91af-02330f788e76 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0" status: 200 len: 353 microversion: 2.1 time: 0.093865 Jun 07 13:13:48.624313 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 12/15] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:48 2022] GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0 => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:48.632294 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0edab754-0297-4ced-ae0d-4a5a1e4d7281 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f5d32820>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:48.661452 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-d603bffb-5d77-4f1d-bece-7a703281adf6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Flavor limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:13:48.661951 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-d603bffb-5d77-4f1d-bece-7a703281adf6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Image limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:13:48.662226 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-d603bffb-5d77-4f1d-bece-7a703281adf6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Flavor pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:13:48.663006 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-d603bffb-5d77-4f1d-bece-7a703281adf6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Image pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:13:48.663495 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-d603bffb-5d77-4f1d-bece-7a703281adf6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:13:48.681540 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0edab754-0297-4ced-ae0d-4a5a1e4d7281 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367" status: 200 len: 287 microversion: 2.1 time: 0.055282 Jun 07 13:13:48.682889 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 13/16] 10.222.0.58 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:48 2022] GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:48.691031 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d603bffb-5d77-4f1d-bece-7a703281adf6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:48.691780 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d603bffb-5d77-4f1d-bece-7a703281adf6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:48.692871 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d603bffb-5d77-4f1d-bece-7a703281adf6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:48.693488 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d603bffb-5d77-4f1d-bece-7a703281adf6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:48.739276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-d603bffb-5d77-4f1d-bece-7a703281adf6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Getting quotas for project f81f8697586042119fcdac2b0e68ad18. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:13:48.749428 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-d603bffb-5d77-4f1d-bece-7a703281adf6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Getting quotas for user 8cfdd6c0bab4493b8ca08dba39121542 and project f81f8697586042119fcdac2b0e68ad18. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:13:48.764715 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d603bffb-5d77-4f1d-bece-7a703281adf6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Going to run 1 instances... {{(pid=117797) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:13:48.767885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d603bffb-5d77-4f1d-bece-7a703281adf6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:13:48.910200 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d603bffb-5d77-4f1d-bece-7a703281adf6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.161495 Jun 07 13:13:48.917641 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 4/17] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:13:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:13:48.923079 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d7f45cc4-7da0-4717-b7be-bece34543ead tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:48.923824 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d7f45cc4-7da0-4717-b7be-bece34543ead tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:49.585880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d7f45cc4-7da0-4717-b7be-bece34543ead tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:49.604397 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d7f45cc4-7da0-4717-b7be-bece34543ead tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1215 microversion: 2.1 time: 0.685722 Jun 07 13:13:49.605321 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 14/18] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:48 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1215 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:49.630250 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-fdfa2b37-32d5-4360-8b0c-ef87b5d31e91 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] Calling method '.version_select at 0x7fb8f5c47310>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:49.694061 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8f80351b-a1c6-471c-a5bc-0b1b7f70ed3d tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f5cfb430>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:49.753967 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8f80351b-a1c6-471c-a5bc-0b1b7f70ed3d tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367" status: 200 len: 287 microversion: 2.1 time: 0.064460 Jun 07 13:13:49.758426 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 15/19] 10.222.0.58 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:49 2022] GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:49.758751 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-fdfa2b37-32d5-4360-8b0c-ef87b5d31e91 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0" status: 200 len: 353 microversion: 2.1 time: 0.132995 Jun 07 13:13:49.759553 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 5/20] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:49 2022] GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0 => generated 353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:50.624038 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-93c15f4a-348a-44f2-b611-105806be0698 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:50.625500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-93c15f4a-348a-44f2-b611-105806be0698 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:50.639212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-93c15f4a-348a-44f2-b611-105806be0698 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:50.641202 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-93c15f4a-348a-44f2-b611-105806be0698 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:50.646087 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-93c15f4a-348a-44f2-b611-105806be0698 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:50.646585 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-93c15f4a-348a-44f2-b611-105806be0698 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:50.771233 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ac323dc2-ac50-44fb-9197-8346ded6e9e4 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f5c47a60>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:50.833260 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ac323dc2-ac50-44fb-9197-8346ded6e9e4 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367" status: 200 len: 287 microversion: 2.1 time: 0.071128 Jun 07 13:13:50.834098 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 6/21] 10.222.0.58 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:50 2022] GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:50.840948 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3c930c3a-0d28-43c7-816d-4ca753f87db2 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] Calling method '.version_select at 0x7fb8f4bd61f0>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:50.918879 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3c930c3a-0d28-43c7-816d-4ca753f87db2 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0" status: 200 len: 353 microversion: 2.1 time: 0.083560 Jun 07 13:13:50.919449 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 7/22] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:50 2022] GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:51.049092 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-93c15f4a-348a-44f2-b611-105806be0698 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:51.071141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-93c15f4a-348a-44f2-b611-105806be0698 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1219 microversion: 2.1 time: 0.451177 Jun 07 13:13:51.072018 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 16/23] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:50 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1219 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:51.847178 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-211e90c3-6f8e-43c3-876f-8356eb5745a5 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f5c47b80>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:51.927237 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-211e90c3-6f8e-43c3-876f-8356eb5745a5 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367" status: 200 len: 287 microversion: 2.1 time: 0.085898 Jun 07 13:13:51.927803 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 8/24] 10.222.0.58 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:51 2022] GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:51.931759 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-71c75f6b-4240-4c3a-864e-622b312bab6a tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] Calling method '.version_select at 0x7fb8f5c7bd30>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:52.035543 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-71c75f6b-4240-4c3a-864e-622b312bab6a tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0" status: 200 len: 353 microversion: 2.1 time: 0.107641 Jun 07 13:13:52.041047 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 17/25] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:51 2022] GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0 => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:13:52.087927 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8639f6f9-5c4a-494f-8433-12178991b0f1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:52.088980 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8639f6f9-5c4a-494f-8433-12178991b0f1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:52.116971 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8639f6f9-5c4a-494f-8433-12178991b0f1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:52.118017 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8639f6f9-5c4a-494f-8433-12178991b0f1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:52.119575 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8639f6f9-5c4a-494f-8433-12178991b0f1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:52.120021 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8639f6f9-5c4a-494f-8433-12178991b0f1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:52.685403 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8639f6f9-5c4a-494f-8433-12178991b0f1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:52.733284 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8639f6f9-5c4a-494f-8433-12178991b0f1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1219 microversion: 2.1 time: 0.649129 Jun 07 13:13:52.733878 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 9/26] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:52 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1219 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:52.952166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c03995f8-3bd2-4d51-8ef3-83f2eec06020 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f5c844c0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:53.027143 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c03995f8-3bd2-4d51-8ef3-83f2eec06020 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367" status: 200 len: 287 microversion: 2.1 time: 0.090864 Jun 07 13:13:53.028135 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 18/27] 10.222.0.58 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:52 2022] GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:53.049964 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c0c586a3-fc62-4d9e-af14-3d5a2ce4d9ce tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] Calling method '.version_select at 0x7fb8f5c47550>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:53.130110 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c0c586a3-fc62-4d9e-af14-3d5a2ce4d9ce tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0" status: 200 len: 353 microversion: 2.1 time: 0.085366 Jun 07 13:13:53.130892 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 10/28] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:53 2022] GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:53.759774 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-30e942df-e7db-4727-97ac-99070ee2cb50 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:53.762823 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-30e942df-e7db-4727-97ac-99070ee2cb50 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:53.776489 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-30e942df-e7db-4727-97ac-99070ee2cb50 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:53.786151 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-30e942df-e7db-4727-97ac-99070ee2cb50 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:53.787135 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-30e942df-e7db-4727-97ac-99070ee2cb50 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:53.788025 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-30e942df-e7db-4727-97ac-99070ee2cb50 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:53.917603 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-30e942df-e7db-4727-97ac-99070ee2cb50 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:53.927530 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-30e942df-e7db-4727-97ac-99070ee2cb50 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1267 microversion: 2.1 time: 0.180666 Jun 07 13:13:53.928931 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 19/29] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:53 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:54.043460 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e05ba94d-40eb-40f0-9a68-57394bbe4f74 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f4b59d30>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:54.094594 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e05ba94d-40eb-40f0-9a68-57394bbe4f74 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367" status: 200 len: 288 microversion: 2.1 time: 0.059120 Jun 07 13:13:54.095698 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 11/30] 10.222.0.58 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:54 2022] GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367 => generated 288 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:54.106563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d3695d07-eaa3-4785-b3d8-2d0a44337249 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f5c110d0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:54.147078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f30ca659-fc05-414a-9541-1561672a8a65 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] Calling method '.version_select at 0x7fb8f4b6f5e0>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:54.210741 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-f30ca659-fc05-414a-9541-1561672a8a65 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] HTTP exception thrown: Volume aaba64b7-7d68-4e39-a28e-9074fddf65c0 could not be found. Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f30ca659-fc05-414a-9541-1561672a8a65 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] Request method failure captured: Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0 HTTP/1.1 Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08FnYUOOMjKeSNF3PWFkukykHcTJskuxsBctg0P-V5eg9BMTTXowkxm4o7faoTnknuKetlVwHVOnfDiXFmEwRC4-kgt04eLbLWv-WmfJxayB2hF6JxgnjRN__RqLEGZOhlQj2JtpaxqZxyGRcD4V2V3C5SBd8YJ6mntNsGuEuz-TwU Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 2733af30e8b64e46bd2cc2578d15a910 Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-VolumesGetTestJSON-566180037 Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:13:54.215037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:13:54.216084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2733af30e8b64e46bd2cc2578d15a910", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2733af30e8b64e46bd2cc2578d15a910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2733af30e8b64e46bd2cc2578d15a910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2733af30e8b64e46bd2cc2578d15a910"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:13:54.216084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-VolumesGetTestJSON-566180037 Jun 07 13:13:54.216084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 2733af30e8b64e46bd2cc2578d15a910 Jun 07 13:13:54.216084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-VolumesGetTestJSON-566180037 Jun 07 13:13:54.216084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-VolumesGetTestJSON-566180037-project Jun 07 13:13:54.216084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:13:54.216084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:13:54.216084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 61066a0ced1d43febf0ea9a3ec10618d Jun 07 13:13:54.216084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-VolumesGetTestJSON-566180037-project Jun 07 13:13:54.216084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: Jun 07 13:13:54.216084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Volume aaba64b7-7d68-4e39-a28e-9074fddf65c0 could not be found. Jun 07 13:13:54.216084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': 'aaba64b7-7d68-4e39-a28e-9074fddf65c0'} Jun 07 13:13:54.216084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aaba64b7-7d68-4e39-a28e-9074fddf65c0 could not be found. (HTTP 404) (Request-ID: req-cea72b37-4b78-499b-874b-e4ab17410ad2) Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:54.216824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:13:54.217721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aaba64b7-7d68-4e39-a28e-9074fddf65c0 could not be found. Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 13:13:54.219137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:13:54.220000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aaba64b7-7d68-4e39-a28e-9074fddf65c0 could not be found. Jun 07 13:13:54.220000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:54.220000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:54.220000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:54.220000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:54.220000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:54.220000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:54.220000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:13:54.220000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:13:54.220000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aaba64b7-7d68-4e39-a28e-9074fddf65c0 could not be found. Jun 07 13:13:54.220000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:54.231173 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f30ca659-fc05-414a-9541-1561672a8a65 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] Returning 404 to user: Volume aaba64b7-7d68-4e39-a28e-9074fddf65c0 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:13:54.233367 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f30ca659-fc05-414a-9541-1561672a8a65 tempest-VolumesGetTestJSON-566180037 tempest-VolumesGetTestJSON-566180037-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0" status: 404 len: 109 microversion: 2.1 time: 0.094782 Jun 07 13:13:54.235599 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 12/31] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:54 2022] GET /compute/v2.1/os-volumes/aaba64b7-7d68-4e39-a28e-9074fddf65c0 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:54.334192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d3695d07-eaa3-4785-b3d8-2d0a44337249 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367" status: 202 len: 0 microversion: 2.1 time: 0.231965 Jun 07 13:13:54.335352 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 20/32] 10.222.0.58 () {58 vars in 1253 bytes} [Tue Jun 7 13:13:54 2022] DELETE /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:13:54.344699 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e4c282a2-17d4-4c86-8b9b-aa01f0e33f00 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f4b6f430>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:54.440058 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e4c282a2-17d4-4c86-8b9b-aa01f0e33f00 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367" status: 200 len: 287 microversion: 2.1 time: 0.100175 Jun 07 13:13:54.440743 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 13/33] 10.222.0.58 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:54 2022] GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367 => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:54.945222 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-786f01c3-ab92-4ed2-95d4-0de7d8d91914 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:54.946013 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-786f01c3-ab92-4ed2-95d4-0de7d8d91914 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:54.954989 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-786f01c3-ab92-4ed2-95d4-0de7d8d91914 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:54.969829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-786f01c3-ab92-4ed2-95d4-0de7d8d91914 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:54.970913 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-786f01c3-ab92-4ed2-95d4-0de7d8d91914 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:54.971431 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-786f01c3-ab92-4ed2-95d4-0de7d8d91914 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:55.364337 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-786f01c3-ab92-4ed2-95d4-0de7d8d91914 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:55.377008 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-786f01c3-ab92-4ed2-95d4-0de7d8d91914 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1273 microversion: 2.1 time: 0.432373 Jun 07 13:13:55.378487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 21/34] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:54 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1273 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:55.452553 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-6065474d-eb87-4bdd-a50b-347b1577548a tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f4b10a60>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:55.505941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-6065474d-eb87-4bdd-a50b-347b1577548a tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] HTTP exception thrown: Snapshot 12fd1a07-5e28-4b07-9eb4-352d1c52f367 could not be found. Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-6065474d-eb87-4bdd-a50b-347b1577548a tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Request method failure captured: Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367 HTTP/1.1 Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08Fsqfbj6FqJDGOs9y3ChuyGUwcwQMo3XCJloM-y-qjUTIWa2SxHtsfChd682OSah0CDKijuuBC1TPjSana5GiRgVH5ByvicX3kytNri3VicbtTjTDcZs0nqgFu5HBx3cxcIzmoT-AFMJfWJhSX0l8QUdsbygpKiNvsoBACd1r6XOE Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 37f4a7f710ba4d5ab3c2940ce9b93aff Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-266491775 Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:13:55.508203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:13:55.509319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_37f4a7f710ba4d5ab3c2940ce9b93aff", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/37f4a7f710ba4d5ab3c2940ce9b93aff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37f4a7f710ba4d5ab3c2940ce9b93aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37f4a7f710ba4d5ab3c2940ce9b93aff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:13:55.509319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-VolumesSnapshotsTestJSON-266491775 Jun 07 13:13:55.509319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 37f4a7f710ba4d5ab3c2940ce9b93aff Jun 07 13:13:55.509319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-266491775 Jun 07 13:13:55.509319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-VolumesSnapshotsTestJSON-266491775-project Jun 07 13:13:55.509319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:13:55.509319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:13:55.509319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: ad3affe6110d481cb40ce728d37b1415 Jun 07 13:13:55.509319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-VolumesSnapshotsTestJSON-266491775-project Jun 07 13:13:55.509319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: Jun 07 13:13:55.509319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Snapshot 12fd1a07-5e28-4b07-9eb4-352d1c52f367 could not be found. Jun 07 13:13:55.509319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': '12fd1a07-5e28-4b07-9eb4-352d1c52f367'} Jun 07 13:13:55.509319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 12fd1a07-5e28-4b07-9eb4-352d1c52f367 could not be found. (HTTP 404) (Request-ID: req-f798c842-9914-4502-8c97-39927b74b919) Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:55.509940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:13:55.510817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 12fd1a07-5e28-4b07-9eb4-352d1c52f367 could not be found. Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 07 13:13:55.511710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:13:55.515748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 12fd1a07-5e28-4b07-9eb4-352d1c52f367 could not be found. Jun 07 13:13:55.515748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:55.515748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:55.515748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:55.515748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:55.515748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:55.515748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:55.515748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:13:55.515748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:13:55.515748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 12fd1a07-5e28-4b07-9eb4-352d1c52f367 could not be found. Jun 07 13:13:55.515748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:55.515748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-6065474d-eb87-4bdd-a50b-347b1577548a tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Returning 404 to user: Snapshot 12fd1a07-5e28-4b07-9eb4-352d1c52f367 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:13:55.515748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-6065474d-eb87-4bdd-a50b-347b1577548a tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367" status: 404 len: 111 microversion: 2.1 time: 0.061125 Jun 07 13:13:55.515748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 14/35] 10.222.0.58 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:55 2022] GET /compute/v2.1/os-snapshots/12fd1a07-5e28-4b07-9eb4-352d1c52f367 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:55.518749 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6f4399b5-8873-47ba-9c05-d6a7e09ce90f tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f5d079d0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:55.709199 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6f4399b5-8873-47ba-9c05-d6a7e09ce90f tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601" status: 202 len: 0 microversion: 2.1 time: 0.194551 Jun 07 13:13:55.709834 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 22/36] 10.222.0.58 () {58 vars in 1247 bytes} [Tue Jun 7 13:13:55 2022] DELETE /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:13:55.719141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-4bf034af-60d2-4168-b6b6-f20ac60da1bb tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f4b10b80>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:55.816608 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-4bf034af-60d2-4168-b6b6-f20ac60da1bb tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601" status: 200 len: 345 microversion: 2.1 time: 0.102403 Jun 07 13:13:55.817459 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 15/37] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:55 2022] GET /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601 => generated 345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:56.396022 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f14d62a2-f5bc-4c74-ad2c-b5174626ed38 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:56.396649 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f14d62a2-f5bc-4c74-ad2c-b5174626ed38 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:56.416433 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f14d62a2-f5bc-4c74-ad2c-b5174626ed38 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:56.417126 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f14d62a2-f5bc-4c74-ad2c-b5174626ed38 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:56.418431 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f14d62a2-f5bc-4c74-ad2c-b5174626ed38 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:56.419100 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f14d62a2-f5bc-4c74-ad2c-b5174626ed38 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:56.572764 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-63a907f7-fbe1-4a9c-bd29-95714bf52d47 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Action: 'create', calling method: .version_select at 0x7fb8f5c110d0>, body: {"keypair": {"name": "tempest-keypair-596909349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7UE89+4qih6UNr2po2GkiTs7sQ4X+Dq/5FovgM+lr/ghj0F9y5j/RrNWpI8e/iHKKd7PInqsC3ZATiCaCxJUU3fd2WYX0GpjN7hCQ+koT8uKRfnqHDg/312iGAJSp7iQ=="}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:56.735276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f14d62a2-f5bc-4c74-ad2c-b5174626ed38 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:56.735865 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-63a907f7-fbe1-4a9c-bd29-95714bf52d47 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Getting quotas for project 3fd6f908209c418490bccdbdef7691a5. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:13:56.748363 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f14d62a2-f5bc-4c74-ad2c-b5174626ed38 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1273 microversion: 2.1 time: 0.356546 Jun 07 13:13:56.748972 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 16/38] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:56 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1273 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:56.763852 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-63a907f7-fbe1-4a9c-bd29-95714bf52d47 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Getting quotas for user 3f1a9bfb57f64b85b635c29090aa498c and project 3fd6f908209c418490bccdbdef7691a5. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:13:56.830163 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-edf25a5b-4bcc-4477-8931-e9a411d3baa5 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f4a97550>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:56.896879 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-63a907f7-fbe1-4a9c-bd29-95714bf52d47 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.663626 Jun 07 13:13:56.898769 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 23/39] 10.222.0.58 () {60 vars in 1158 bytes} [Tue Jun 7 13:13:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:56.930423 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-edf25a5b-4bcc-4477-8931-e9a411d3baa5 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] HTTP exception thrown: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-edf25a5b-4bcc-4477-8931-e9a411d3baa5 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Request method failure captured: Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601 HTTP/1.1 Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08Fsqfbj6FqJDGOs9y3ChuyGUwcwQMo3XCJloM-y-qjUTIWa2SxHtsfChd682OSah0CDKijuuBC1TPjSana5GiRgVH5ByvicX3kytNri3VicbtTjTDcZs0nqgFu5HBx3cxcIzmoT-AFMJfWJhSX0l8QUdsbygpKiNvsoBACd1r6XOE Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 37f4a7f710ba4d5ab3c2940ce9b93aff Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-266491775 Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:13:56.932885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:13:56.934137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_37f4a7f710ba4d5ab3c2940ce9b93aff", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/37f4a7f710ba4d5ab3c2940ce9b93aff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37f4a7f710ba4d5ab3c2940ce9b93aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37f4a7f710ba4d5ab3c2940ce9b93aff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:13:56.934137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-VolumesSnapshotsTestJSON-266491775 Jun 07 13:13:56.934137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 37f4a7f710ba4d5ab3c2940ce9b93aff Jun 07 13:13:56.934137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-266491775 Jun 07 13:13:56.934137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-VolumesSnapshotsTestJSON-266491775-project Jun 07 13:13:56.934137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:13:56.934137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:13:56.934137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: ad3affe6110d481cb40ce728d37b1415 Jun 07 13:13:56.934137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-VolumesSnapshotsTestJSON-266491775-project Jun 07 13:13:56.934137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: Jun 07 13:13:56.934137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. Jun 07 13:13:56.934137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': '71984b86-4fd8-46db-92ad-7a081b0f8601'} Jun 07 13:13:56.934137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. (HTTP 404) (Request-ID: req-c0116154-9fd8-4d8f-9a9f-67ee103fbb25) Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:56.934787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:13:56.935686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 13:13:56.936582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:13:56.938043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. Jun 07 13:13:56.938043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.938043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:56.938043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.938043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:56.938043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:56.938043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:56.938043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:13:56.938043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:13:56.938043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. Jun 07 13:13:56.938043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.938043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-edf25a5b-4bcc-4477-8931-e9a411d3baa5 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Returning 404 to user: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:13:56.938043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-edf25a5b-4bcc-4477-8931-e9a411d3baa5 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601" status: 404 len: 109 microversion: 2.1 time: 0.108561 Jun 07 13:13:56.938043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 17/40] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:56 2022] GET /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:56.954392 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-977bbcad-cb5f-4a9d-8407-51e84f379108 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f5bc4430>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:57.047262 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-977bbcad-cb5f-4a9d-8407-51e84f379108 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] HTTP exception thrown: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-977bbcad-cb5f-4a9d-8407-51e84f379108 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Request method failure captured: Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: DELETE /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601 HTTP/1.1 Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08Fsqfbj6FqJDGOs9y3ChuyGUwcwQMo3XCJloM-y-qjUTIWa2SxHtsfChd682OSah0CDKijuuBC1TPjSana5GiRgVH5ByvicX3kytNri3VicbtTjTDcZs0nqgFu5HBx3cxcIzmoT-AFMJfWJhSX0l8QUdsbygpKiNvsoBACd1r6XOE Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 37f4a7f710ba4d5ab3c2940ce9b93aff Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-266491775 Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:13:57.065985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:13:57.067545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_37f4a7f710ba4d5ab3c2940ce9b93aff", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/37f4a7f710ba4d5ab3c2940ce9b93aff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37f4a7f710ba4d5ab3c2940ce9b93aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37f4a7f710ba4d5ab3c2940ce9b93aff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:13:57.067545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-VolumesSnapshotsTestJSON-266491775 Jun 07 13:13:57.067545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 37f4a7f710ba4d5ab3c2940ce9b93aff Jun 07 13:13:57.067545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-266491775 Jun 07 13:13:57.067545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-VolumesSnapshotsTestJSON-266491775-project Jun 07 13:13:57.067545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:13:57.067545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:13:57.067545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: ad3affe6110d481cb40ce728d37b1415 Jun 07 13:13:57.067545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-VolumesSnapshotsTestJSON-266491775-project Jun 07 13:13:57.067545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: Jun 07 13:13:57.067545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. Jun 07 13:13:57.067545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': '71984b86-4fd8-46db-92ad-7a081b0f8601'} Jun 07 13:13:57.067545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. (HTTP 404) (Request-ID: req-4f20dec8-e17a-497c-a7c1-eb49a980da89) Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:57.068349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:13:57.069958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 13:13:57.073187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:13:57.077083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. Jun 07 13:13:57.077083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:13:57.077083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:57.077083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:13:57.077083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:57.077083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:57.077083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:57.077083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:13:57.077083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:13:57.077083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. Jun 07 13:13:57.077083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:13:57.079677 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-977bbcad-cb5f-4a9d-8407-51e84f379108 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Returning 404 to user: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:13:57.087006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-977bbcad-cb5f-4a9d-8407-51e84f379108 tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601" status: 404 len: 109 microversion: 2.1 time: 0.128305 Jun 07 13:13:57.092362 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 24/41] 10.222.0.58 () {58 vars in 1247 bytes} [Tue Jun 7 13:13:56 2022] DELETE /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601 => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:57.099659 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-dca3606b-f5ef-4b8a-ac92-f2e518477f7f tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Calling method '.version_select at 0x7fb8f4a8c0d0>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:57.204565 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-dca3606b-f5ef-4b8a-ac92-f2e518477f7f tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] HTTP exception thrown: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-dca3606b-f5ef-4b8a-ac92-f2e518477f7f tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Request method failure captured: Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601 HTTP/1.1 Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08Fsqfbj6FqJDGOs9y3ChuyGUwcwQMo3XCJloM-y-qjUTIWa2SxHtsfChd682OSah0CDKijuuBC1TPjSana5GiRgVH5ByvicX3kytNri3VicbtTjTDcZs0nqgFu5HBx3cxcIzmoT-AFMJfWJhSX0l8QUdsbygpKiNvsoBACd1r6XOE Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 37f4a7f710ba4d5ab3c2940ce9b93aff Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-266491775 Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:13:57.207066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:13:57.208127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_37f4a7f710ba4d5ab3c2940ce9b93aff", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/37f4a7f710ba4d5ab3c2940ce9b93aff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37f4a7f710ba4d5ab3c2940ce9b93aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37f4a7f710ba4d5ab3c2940ce9b93aff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:13:57.208127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-VolumesSnapshotsTestJSON-266491775 Jun 07 13:13:57.208127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 37f4a7f710ba4d5ab3c2940ce9b93aff Jun 07 13:13:57.208127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-266491775 Jun 07 13:13:57.208127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-VolumesSnapshotsTestJSON-266491775-project Jun 07 13:13:57.208127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:13:57.208127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:13:57.208127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: ad3affe6110d481cb40ce728d37b1415 Jun 07 13:13:57.208127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-VolumesSnapshotsTestJSON-266491775-project Jun 07 13:13:57.208127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: Jun 07 13:13:57.208127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. Jun 07 13:13:57.208127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': '71984b86-4fd8-46db-92ad-7a081b0f8601'} Jun 07 13:13:57.208127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. (HTTP 404) (Request-ID: req-2ce0d06f-2168-49b6-a8f1-bcb96f0de5a9) Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:57.208767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:13:57.213116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 13:13:57.214097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:13:57.215003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. Jun 07 13:13:57.215003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:57.215003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:57.215003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:57.215003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:57.215003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:57.215003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:57.215003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:13:57.215003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:13:57.215003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. Jun 07 13:13:57.215003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:13:57.215003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-dca3606b-f5ef-4b8a-ac92-f2e518477f7f tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] Returning 404 to user: Volume 71984b86-4fd8-46db-92ad-7a081b0f8601 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:13:57.215003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-dca3606b-f5ef-4b8a-ac92-f2e518477f7f tempest-VolumesSnapshotsTestJSON-266491775 tempest-VolumesSnapshotsTestJSON-266491775-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601" status: 404 len: 109 microversion: 2.1 time: 0.116090 Jun 07 13:13:57.215003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 18/42] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:57 2022] GET /compute/v2.1/os-volumes/71984b86-4fd8-46db-92ad-7a081b0f8601 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:57.767240 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-25ffcb11-676c-42cd-990f-2cc0c37365f2 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:57.769228 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-25ffcb11-676c-42cd-990f-2cc0c37365f2 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:57.798078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-25ffcb11-676c-42cd-990f-2cc0c37365f2 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:57.798786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-25ffcb11-676c-42cd-990f-2cc0c37365f2 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:57.807788 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-25ffcb11-676c-42cd-990f-2cc0c37365f2 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:57.808353 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-25ffcb11-676c-42cd-990f-2cc0c37365f2 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:58.352523 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-25ffcb11-676c-42cd-990f-2cc0c37365f2 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:58.375363 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-25ffcb11-676c-42cd-990f-2cc0c37365f2 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1273 microversion: 2.1 time: 0.610776 Jun 07 13:13:58.380783 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 25/43] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:57 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1273 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:59.394035 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=2 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:59.395458 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=6 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:59.403079 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-26367f5d-0980-468f-836d-8eaa8005c019 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:59.403079 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-26367f5d-0980-468f-836d-8eaa8005c019 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:59.419669 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-26367f5d-0980-468f-836d-8eaa8005c019 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:59.424738 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-26367f5d-0980-468f-836d-8eaa8005c019 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:59.426400 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-26367f5d-0980-468f-836d-8eaa8005c019 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:59.427070 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-26367f5d-0980-468f-836d-8eaa8005c019 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:00.875616 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-26367f5d-0980-468f-836d-8eaa8005c019 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:00.885654 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-26367f5d-0980-468f-836d-8eaa8005c019 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 1.492314 Jun 07 13:14:00.887206 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 19/44] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:59 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:01.915516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e56a69d9-081d-44ea-b587-ae903f169756 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:01.916586 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e56a69d9-081d-44ea-b587-ae903f169756 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:01.932349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e56a69d9-081d-44ea-b587-ae903f169756 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:01.932816 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e56a69d9-081d-44ea-b587-ae903f169756 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:01.933608 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e56a69d9-081d-44ea-b587-ae903f169756 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:01.934055 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e56a69d9-081d-44ea-b587-ae903f169756 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:02.696704 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e56a69d9-081d-44ea-b587-ae903f169756 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:02.711167 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e56a69d9-081d-44ea-b587-ae903f169756 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.802720 Jun 07 13:14:02.711772 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 26/45] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:01 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:03.728486 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ffa4a23f-a51c-45de-8812-983f71c4f3ff tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:03.729710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ffa4a23f-a51c-45de-8812-983f71c4f3ff tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:03.743922 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ffa4a23f-a51c-45de-8812-983f71c4f3ff tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:03.744575 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ffa4a23f-a51c-45de-8812-983f71c4f3ff tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:03.745557 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ffa4a23f-a51c-45de-8812-983f71c4f3ff tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:03.751133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ffa4a23f-a51c-45de-8812-983f71c4f3ff tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:04.406309 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ffa4a23f-a51c-45de-8812-983f71c4f3ff tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:04.425265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ffa4a23f-a51c-45de-8812-983f71c4f3ff tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.698107 Jun 07 13:14:04.427247 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 20/46] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:03 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:04.435017 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-20166e5c-a1ae-4e9b-9a69-ea26f59231c1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Action: 'create', calling method: .version_select at 0x7fb8f52d9f70>, body: {"keypair": {"name": "tempest-keypair-2105419996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiDj1IoPt09asVV+JUQ8s0aPWG34pvTDFyZ1OUcxTObkzq9PTsF40oJr+XOWcTq/YdK3eNdDezF9pLPBtuOIsqEVaSnNWlEW7nRRW21ILrxSlT4b4y8c0hGmwbSqyz9aQ=="}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:04.504048 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-20166e5c-a1ae-4e9b-9a69-ea26f59231c1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Getting quotas for project 42e8fd59ba6046ad9185164e19c0be0f. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:14:04.519575 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-20166e5c-a1ae-4e9b-9a69-ea26f59231c1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Getting quotas for user 40a46709afbe46cbb93f6e2a1760d0c5 and project 42e8fd59ba6046ad9185164e19c0be0f. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:14:04.592316 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-20166e5c-a1ae-4e9b-9a69-ea26f59231c1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.686342 Jun 07 13:14:04.593428 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 27/47] 10.222.0.58 () {60 vars in 1158 bytes} [Tue Jun 7 13:14:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:14:04.910904 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-eeba7dbb-05d0-45b4-b9d8-c1a8cdd80dfe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-513741571", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a83b14f0-daca-457b-9e46-5ac0b9a7ecdf"}], "security_groups": [{"name": "tempest-securitygroup--999423282"}], "key_name": "tempest-keypair-596909349", "user_data": "}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:05.298657 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.network.neutron [None req-eeba7dbb-05d0-45b4-b9d8-c1a8cdd80dfe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] validate_networks() for [('a83b14f0-daca-457b-9e46-5ac0b9a7ecdf', None, None, None, None, None)] {{(pid=117797) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:14:05.444152 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f3bb3cf4-857b-41ee-88e4-a44440e89d47 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:05.444880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f3bb3cf4-857b-41ee-88e4-a44440e89d47 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:05.457799 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f3bb3cf4-857b-41ee-88e4-a44440e89d47 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:05.459858 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f3bb3cf4-857b-41ee-88e4-a44440e89d47 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:05.463250 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f3bb3cf4-857b-41ee-88e4-a44440e89d47 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:05.465609 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f3bb3cf4-857b-41ee-88e4-a44440e89d47 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:06.378875 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f3bb3cf4-857b-41ee-88e4-a44440e89d47 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:06.404101 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f3bb3cf4-857b-41ee-88e4-a44440e89d47 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.964421 Jun 07 13:14:06.419845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 28/48] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:05 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:06.701028 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-eeba7dbb-05d0-45b4-b9d8-c1a8cdd80dfe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Flavor limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:14:06.702926 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-eeba7dbb-05d0-45b4-b9d8-c1a8cdd80dfe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Image limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:14:06.706058 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-eeba7dbb-05d0-45b4-b9d8-c1a8cdd80dfe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Flavor pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:14:06.707528 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-eeba7dbb-05d0-45b4-b9d8-c1a8cdd80dfe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Image pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:14:06.708979 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-eeba7dbb-05d0-45b4-b9d8-c1a8cdd80dfe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:14:06.733039 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-eeba7dbb-05d0-45b4-b9d8-c1a8cdd80dfe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:06.733702 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-eeba7dbb-05d0-45b4-b9d8-c1a8cdd80dfe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:06.734644 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-eeba7dbb-05d0-45b4-b9d8-c1a8cdd80dfe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:06.735314 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-eeba7dbb-05d0-45b4-b9d8-c1a8cdd80dfe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:06.757916 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-eeba7dbb-05d0-45b4-b9d8-c1a8cdd80dfe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Getting quotas for project 3fd6f908209c418490bccdbdef7691a5. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:14:06.763422 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-eeba7dbb-05d0-45b4-b9d8-c1a8cdd80dfe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Getting quotas for user 3f1a9bfb57f64b85b635c29090aa498c and project 3fd6f908209c418490bccdbdef7691a5. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:14:06.778969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-eeba7dbb-05d0-45b4-b9d8-c1a8cdd80dfe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Going to run 1 instances... {{(pid=117797) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:14:06.782388 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-eeba7dbb-05d0-45b4-b9d8-c1a8cdd80dfe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:14:06.849647 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-eeba7dbb-05d0-45b4-b9d8-c1a8cdd80dfe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.948677 Jun 07 13:14:06.850829 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 21/49] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:14:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:14:06.865634 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f28976be-704b-4a05-9ada-b698fde4f75d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:06.866408 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f28976be-704b-4a05-9ada-b698fde4f75d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:07.101702 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f28976be-704b-4a05-9ada-b698fde4f75d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:07.110079 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f28976be-704b-4a05-9ada-b698fde4f75d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1240 microversion: 2.1 time: 0.252139 Jun 07 13:14:07.113219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 29/50] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:06 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1240 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:07.162025 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ca2fde42-6696-48a3-a67d-b6463ac36704 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Action: 'create', calling method: .version_select at 0x7fb8f4a8c040>, body: {"keypair": {"name": "tempest-keypair-1874319868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRQNe1X/vxffqxpnzJz32j8DF65PiZvU0JWaaq9dwC9w7sLAkqIWXzKpsKVG7TJxr92Y9cyEGyO/WSV/xlSvZrVlzrHgInQ11GE2aKyyHPVtjD09stTT5EH05TpfR2dkg=="}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:07.197412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-ca2fde42-6696-48a3-a67d-b6463ac36704 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Getting quotas for project 1415de13612d47928af70862de8576be. Resources: {'key_pairs'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:14:07.203186 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-ca2fde42-6696-48a3-a67d-b6463ac36704 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Getting quotas for user c1785cda265641259d831cb0b6a6a34b and project 1415de13612d47928af70862de8576be. Resources: {'key_pairs'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:14:07.340221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ca2fde42-6696-48a3-a67d-b6463ac36704 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.446411 Jun 07 13:14:07.340908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 22/51] 10.222.0.58 () {62 vars in 1199 bytes} [Tue Jun 7 13:14:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 448 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 07 13:14:07.436574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e640adbc-842e-48bc-b038-0056c7f475de tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:07.442803 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e640adbc-842e-48bc-b038-0056c7f475de tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:07.464160 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e640adbc-842e-48bc-b038-0056c7f475de tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:07.471403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e640adbc-842e-48bc-b038-0056c7f475de tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:07.474923 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e640adbc-842e-48bc-b038-0056c7f475de tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:07.477116 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e640adbc-842e-48bc-b038-0056c7f475de tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:07.867252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7ee9c700-cc30-4ad3-9fe6-4a2115fb4f37 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-136615422", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:08.063953 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.network.neutron [None req-7ee9c700-cc30-4ad3-9fe6-4a2115fb4f37 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] validate_networks() for [('fa538802-df75-4c2f-ac7b-58fa0b9db040', None, None, None, None, None)] {{(pid=117797) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:14:09.195911 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e640adbc-842e-48bc-b038-0056c7f475de tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:09.205856 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e640adbc-842e-48bc-b038-0056c7f475de tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 1.773046 Jun 07 13:14:09.219232 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 30/52] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:07 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:09.224105 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a2267d47-9364-4c40-873b-53b137836331 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:09.236724 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a2267d47-9364-4c40-873b-53b137836331 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:09.252658 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a2267d47-9364-4c40-873b-53b137836331 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:09.253143 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a2267d47-9364-4c40-873b-53b137836331 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:09.258935 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a2267d47-9364-4c40-873b-53b137836331 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:09.267205 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a2267d47-9364-4c40-873b-53b137836331 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:09.537681 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a2267d47-9364-4c40-873b-53b137836331 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:09.553208 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a2267d47-9364-4c40-873b-53b137836331 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1236 microversion: 2.1 time: 0.332749 Jun 07 13:14:09.573026 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 31/53] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:09 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1236 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:09.815484 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-1fd83d75-b919-4119-b6f5-d166523d842c req-90ca6daf-aa4d-472d-88af-eb1179df0513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c78e5cc8-7238-4286-aae7-13544b3bcb99", "tag": "72137dbd-ac58-46a3-a21f-b1f0720047f9"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:09.862318 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-1fd83d75-b919-4119-b6f5-d166523d842c req-90ca6daf-aa4d-472d-88af-eb1179df0513 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:09.864593 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-1fd83d75-b919-4119-b6f5-d166523d842c req-90ca6daf-aa4d-472d-88af-eb1179df0513 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:09.935398 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-1fd83d75-b919-4119-b6f5-d166523d842c req-90ca6daf-aa4d-472d-88af-eb1179df0513 service nova] Creating event network-changed:72137dbd-ac58-46a3-a21f-b1f0720047f9 for instance c78e5cc8-7238-4286-aae7-13544b3bcb99 on hv-cinder-84496 Jun 07 13:14:09.937872 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-1fd83d75-b919-4119-b6f5-d166523d842c req-90ca6daf-aa4d-472d-88af-eb1179df0513 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117798) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 13:14:09.940564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c507162-ffff-4e26-b143-93e92281d894 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:09.943340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c507162-ffff-4e26-b143-93e92281d894 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:09.945969 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c507162-ffff-4e26-b143-93e92281d894 None None] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:09.948535 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c507162-ffff-4e26-b143-93e92281d894 None None] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:09.984997 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.compute.rpcapi [None req-3c507162-ffff-4e26-b143-93e92281d894 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 13:14:09.987335 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c507162-ffff-4e26-b143-93e92281d894 None None] Releasing lock "compute-rpcapi-router" {{(pid=117798) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 13:14:10.058742 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3c507162-ffff-4e26-b143-93e92281d894 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.482453 Jun 07 13:14:10.071342 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 32/54] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:14:10.188765 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-898fff85-d0fe-42bf-8b22-72442a652226 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1942805382", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e959e3ea-2acf-4707-8260-cf27b3e4b096"}], "security_groups": [{"name": "tempest-securitygroup--1852960528"}], "key_name": "tempest-keypair-2105419996", "user_data": "}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:10.600580 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-7ee9c700-cc30-4ad3-9fe6-4a2115fb4f37 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Flavor limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:14:10.601651 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-7ee9c700-cc30-4ad3-9fe6-4a2115fb4f37 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Image limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:14:10.602465 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-7ee9c700-cc30-4ad3-9fe6-4a2115fb4f37 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Flavor pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:14:10.603545 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-7ee9c700-cc30-4ad3-9fe6-4a2115fb4f37 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Image pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:14:10.604121 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-7ee9c700-cc30-4ad3-9fe6-4a2115fb4f37 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:14:10.623260 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7ee9c700-cc30-4ad3-9fe6-4a2115fb4f37 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:10.626040 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7ee9c700-cc30-4ad3-9fe6-4a2115fb4f37 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:10.627989 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7ee9c700-cc30-4ad3-9fe6-4a2115fb4f37 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:10.628735 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7ee9c700-cc30-4ad3-9fe6-4a2115fb4f37 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:10.674923 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-7ee9c700-cc30-4ad3-9fe6-4a2115fb4f37 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Getting quotas for project 562a790e14024341b71d99b5b56fdbfb. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:14:10.709909 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-7ee9c700-cc30-4ad3-9fe6-4a2115fb4f37 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Getting quotas for user 3f1820e65ba6475d95f5614a9e035019 and project 562a790e14024341b71d99b5b56fdbfb. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:14:10.786538 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7ee9c700-cc30-4ad3-9fe6-4a2115fb4f37 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Going to run 1 instances... {{(pid=117797) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:14:10.808061 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7ee9c700-cc30-4ad3-9fe6-4a2115fb4f37 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:14:11.021574 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-7ee9c700-cc30-4ad3-9fe6-4a2115fb4f37 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.268625 Jun 07 13:14:11.040330 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 23/55] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:14:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 3276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 13:14:11.070352 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-fd03a321-c92f-4fca-a096-fde6f6efbc95 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:11.097938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-fd03a321-c92f-4fca-a096-fde6f6efbc95 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:11.166962 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fd03a321-c92f-4fca-a096-fde6f6efbc95 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:11.171564 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fd03a321-c92f-4fca-a096-fde6f6efbc95 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:11.178310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fd03a321-c92f-4fca-a096-fde6f6efbc95 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:11.178542 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fd03a321-c92f-4fca-a096-fde6f6efbc95 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:11.372952 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-898fff85-d0fe-42bf-8b22-72442a652226 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] validate_networks() for [('e959e3ea-2acf-4707-8260-cf27b3e4b096', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:14:12.022691 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-fd03a321-c92f-4fca-a096-fde6f6efbc95 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:12.027165 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=35 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:12.057729 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-fd03a321-c92f-4fca-a096-fde6f6efbc95 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 1.027931 Jun 07 13:14:12.061202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 24/56] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:11 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:12.076202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-60d3f4cd-702f-4613-9279-ba022b280eec tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:12.077850 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-60d3f4cd-702f-4613-9279-ba022b280eec tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:12.096279 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=10 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:12.101852 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-60d3f4cd-702f-4613-9279-ba022b280eec tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:12.102970 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-60d3f4cd-702f-4613-9279-ba022b280eec tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:12.105166 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-60d3f4cd-702f-4613-9279-ba022b280eec tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:12.107340 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-60d3f4cd-702f-4613-9279-ba022b280eec tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:12.386597 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:12.566471 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-60d3f4cd-702f-4613-9279-ba022b280eec tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:12.580021 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-60d3f4cd-702f-4613-9279-ba022b280eec tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1298 microversion: 2.1 time: 0.515801 Jun 07 13:14:12.594815 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 25/57] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:12 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1298 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:12.600078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c17b4856-29af-45b3-934b-d91b75835fe1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:12.603136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c17b4856-29af-45b3-934b-d91b75835fe1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:12.617715 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c17b4856-29af-45b3-934b-d91b75835fe1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:12.618539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c17b4856-29af-45b3-934b-d91b75835fe1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:12.619510 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c17b4856-29af-45b3-934b-d91b75835fe1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:12.620100 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c17b4856-29af-45b3-934b-d91b75835fe1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:12.812043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c17b4856-29af-45b3-934b-d91b75835fe1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:12.820847 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c17b4856-29af-45b3-934b-d91b75835fe1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1217 microversion: 2.1 time: 0.224637 Jun 07 13:14:12.827657 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 26/58] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:12 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:13.023765 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ce8fb0c0-69e5-4797-a7b0-daea7567ba08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1676552473", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:13.109246 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.network.neutron [None req-ce8fb0c0-69e5-4797-a7b0-daea7567ba08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] validate_networks() for [('fa538802-df75-4c2f-ac7b-58fa0b9db040', None, None, None, None, None)] {{(pid=117797) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:14:13.133189 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-898fff85-d0fe-42bf-8b22-72442a652226 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:14:13.133642 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-898fff85-d0fe-42bf-8b22-72442a652226 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:14:13.134372 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-898fff85-d0fe-42bf-8b22-72442a652226 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:14:13.134844 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-898fff85-d0fe-42bf-8b22-72442a652226 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:14:13.135403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-898fff85-d0fe-42bf-8b22-72442a652226 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:14:13.152305 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=13 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:13.157884 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-898fff85-d0fe-42bf-8b22-72442a652226 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:13.158355 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-898fff85-d0fe-42bf-8b22-72442a652226 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:13.161763 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-898fff85-d0fe-42bf-8b22-72442a652226 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:13.162487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-898fff85-d0fe-42bf-8b22-72442a652226 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:13.188334 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=53 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:13.220810 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-898fff85-d0fe-42bf-8b22-72442a652226 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Getting quotas for project 42e8fd59ba6046ad9185164e19c0be0f. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:14:13.232983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-898fff85-d0fe-42bf-8b22-72442a652226 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Getting quotas for user 40a46709afbe46cbb93f6e2a1760d0c5 and project 42e8fd59ba6046ad9185164e19c0be0f. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:14:13.264078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-898fff85-d0fe-42bf-8b22-72442a652226 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:14:13.268657 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-898fff85-d0fe-42bf-8b22-72442a652226 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:14:13.441580 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-898fff85-d0fe-42bf-8b22-72442a652226 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.263388 Jun 07 13:14:13.451487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 33/59] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:14:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 3274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 13:14:13.457618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7e538c68-035d-4a58-9328-cb9d811ed0f5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:13.458322 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7e538c68-035d-4a58-9328-cb9d811ed0f5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:13.484128 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7e538c68-035d-4a58-9328-cb9d811ed0f5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:13.484966 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7e538c68-035d-4a58-9328-cb9d811ed0f5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:13.487164 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7e538c68-035d-4a58-9328-cb9d811ed0f5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:13.489258 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7e538c68-035d-4a58-9328-cb9d811ed0f5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:14.317674 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7e538c68-035d-4a58-9328-cb9d811ed0f5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:14.328851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7e538c68-035d-4a58-9328-cb9d811ed0f5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.875351 Jun 07 13:14:14.345046 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 34/60] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:13 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:14.362605 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-45c7336e-70e9-4ee4-b36f-25bf780a4f12 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:14.367500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-45c7336e-70e9-4ee4-b36f-25bf780a4f12 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:14.510795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-45c7336e-70e9-4ee4-b36f-25bf780a4f12 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:14.529912 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-45c7336e-70e9-4ee4-b36f-25bf780a4f12 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1238 microversion: 2.1 time: 0.180674 Jun 07 13:14:14.530609 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 35/61] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:14 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1238 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:14.556482 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e9a9928b-380d-4a77-8a91-b9a27d5598c2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:14.557122 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e9a9928b-380d-4a77-8a91-b9a27d5598c2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:14.578374 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e9a9928b-380d-4a77-8a91-b9a27d5598c2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:14.584012 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e9a9928b-380d-4a77-8a91-b9a27d5598c2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:14.585305 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e9a9928b-380d-4a77-8a91-b9a27d5598c2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:14.586370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e9a9928b-380d-4a77-8a91-b9a27d5598c2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:15.044050 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e9a9928b-380d-4a77-8a91-b9a27d5598c2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:15.054758 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e9a9928b-380d-4a77-8a91-b9a27d5598c2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.517719 Jun 07 13:14:15.056011 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 36/62] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:14 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:15.336654 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-ce8fb0c0-69e5-4797-a7b0-daea7567ba08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Flavor limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:14:15.337623 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-ce8fb0c0-69e5-4797-a7b0-daea7567ba08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Image limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:14:15.338259 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-ce8fb0c0-69e5-4797-a7b0-daea7567ba08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Flavor pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:14:15.338847 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-ce8fb0c0-69e5-4797-a7b0-daea7567ba08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Image pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:14:15.339429 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-ce8fb0c0-69e5-4797-a7b0-daea7567ba08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:14:15.349423 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-dec2501a-6de5-449a-b74d-bd427ff20040 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:15.350152 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-dec2501a-6de5-449a-b74d-bd427ff20040 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:15.360756 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dec2501a-6de5-449a-b74d-bd427ff20040 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:15.364033 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce8fb0c0-69e5-4797-a7b0-daea7567ba08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:15.364260 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dec2501a-6de5-449a-b74d-bd427ff20040 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:15.365147 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce8fb0c0-69e5-4797-a7b0-daea7567ba08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:15.366118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce8fb0c0-69e5-4797-a7b0-daea7567ba08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:15.366738 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce8fb0c0-69e5-4797-a7b0-daea7567ba08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:15.367649 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dec2501a-6de5-449a-b74d-bd427ff20040 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:15.368759 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dec2501a-6de5-449a-b74d-bd427ff20040 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:15.409586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-ce8fb0c0-69e5-4797-a7b0-daea7567ba08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Getting quotas for project 562a790e14024341b71d99b5b56fdbfb. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:14:15.421620 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-ce8fb0c0-69e5-4797-a7b0-daea7567ba08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Getting quotas for user 3f1820e65ba6475d95f5614a9e035019 and project 562a790e14024341b71d99b5b56fdbfb. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:14:15.451226 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ce8fb0c0-69e5-4797-a7b0-daea7567ba08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Going to run 1 instances... {{(pid=117797) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:14:15.459431 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ce8fb0c0-69e5-4797-a7b0-daea7567ba08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:14:15.566976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ce8fb0c0-69e5-4797-a7b0-daea7567ba08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.537495 Jun 07 13:14:15.572404 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 27/63] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:14:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 2553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:14:15.579738 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0aab4b0e-1dec-4917-9795-e7c39734bcb2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:15.580971 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0aab4b0e-1dec-4917-9795-e7c39734bcb2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:15.589151 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0aab4b0e-1dec-4917-9795-e7c39734bcb2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:15.589872 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0aab4b0e-1dec-4917-9795-e7c39734bcb2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:15.591548 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0aab4b0e-1dec-4917-9795-e7c39734bcb2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:15.592146 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0aab4b0e-1dec-4917-9795-e7c39734bcb2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:15.725260 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0aab4b0e-1dec-4917-9795-e7c39734bcb2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:15.740150 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0aab4b0e-1dec-4917-9795-e7c39734bcb2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1242 microversion: 2.1 time: 0.166276 Jun 07 13:14:15.741007 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 28/64] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:15 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1242 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:15.746506 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d46fa0b6-6417-403a-81cd-3c0b8966cd16 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:15.747323 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d46fa0b6-6417-403a-81cd-3c0b8966cd16 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:15.849173 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d46fa0b6-6417-403a-81cd-3c0b8966cd16 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:15.874069 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d46fa0b6-6417-403a-81cd-3c0b8966cd16 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1222 microversion: 2.1 time: 0.131594 Jun 07 13:14:15.890858 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 29/65] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:15 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:16.094510 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1627276f-d459-4e36-9511-2b5518dc1e0e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:16.095097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1627276f-d459-4e36-9511-2b5518dc1e0e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:16.112038 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1627276f-d459-4e36-9511-2b5518dc1e0e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:16.112494 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1627276f-d459-4e36-9511-2b5518dc1e0e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:16.113297 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1627276f-d459-4e36-9511-2b5518dc1e0e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:16.113739 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1627276f-d459-4e36-9511-2b5518dc1e0e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:16.153068 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-dec2501a-6de5-449a-b74d-bd427ff20040 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:16.178473 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-dec2501a-6de5-449a-b74d-bd427ff20040 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.828376 Jun 07 13:14:16.179126 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 37/66] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:15 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:16.761320 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9c6865b2-06e0-46b3-b1c7-a22ce056cff7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:16.762365 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9c6865b2-06e0-46b3-b1c7-a22ce056cff7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:16.781138 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9c6865b2-06e0-46b3-b1c7-a22ce056cff7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:16.783286 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9c6865b2-06e0-46b3-b1c7-a22ce056cff7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:16.793622 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9c6865b2-06e0-46b3-b1c7-a22ce056cff7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:16.794500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9c6865b2-06e0-46b3-b1c7-a22ce056cff7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:17.019138 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1627276f-d459-4e36-9511-2b5518dc1e0e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:17.032111 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1627276f-d459-4e36-9511-2b5518dc1e0e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.962819 Jun 07 13:14:17.039226 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 30/67] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:16 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:17.053154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-01f42441-38c6-4b25-81e8-9eb58909da39 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:17.056181 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-01f42441-38c6-4b25-81e8-9eb58909da39 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:17.078835 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-01f42441-38c6-4b25-81e8-9eb58909da39 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:17.079255 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-01f42441-38c6-4b25-81e8-9eb58909da39 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:17.080052 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-01f42441-38c6-4b25-81e8-9eb58909da39 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:17.080552 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-01f42441-38c6-4b25-81e8-9eb58909da39 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:17.153725 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9c6865b2-06e0-46b3-b1c7-a22ce056cff7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:17.176644 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9c6865b2-06e0-46b3-b1c7-a22ce056cff7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1242 microversion: 2.1 time: 0.423081 Jun 07 13:14:17.188351 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 38/68] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:16 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1242 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:17.200809 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-be28f1d8-2f89-49af-9161-fbc2fa532576 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:17.203302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-be28f1d8-2f89-49af-9161-fbc2fa532576 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:17.256174 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-be28f1d8-2f89-49af-9161-fbc2fa532576 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:17.260001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-be28f1d8-2f89-49af-9161-fbc2fa532576 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:17.266824 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-be28f1d8-2f89-49af-9161-fbc2fa532576 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:17.269602 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-be28f1d8-2f89-49af-9161-fbc2fa532576 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:17.475516 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-01f42441-38c6-4b25-81e8-9eb58909da39 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:17.491051 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-01f42441-38c6-4b25-81e8-9eb58909da39 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1226 microversion: 2.1 time: 0.450378 Jun 07 13:14:17.491641 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 31/69] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:17 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1226 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:17.497015 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7adeaad9-53d7-4237-ab39-380965ae985e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-671640421", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da70da4e-9138-45ce-9988-0dcf0221903b"}], "security_groups": [{"name": "tempest-securitygroup--1749477708"}], "key_name": "tempest-keypair-1874319868", "user_data": "}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:17.948542 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-be28f1d8-2f89-49af-9161-fbc2fa532576 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:17.960816 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-be28f1d8-2f89-49af-9161-fbc2fa532576 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.766000 Jun 07 13:14:17.964560 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 39/70] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:17 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:18.051949 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-81d02cde-36fd-4f22-83d8-8ae878e4aed5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:18.052743 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-81d02cde-36fd-4f22-83d8-8ae878e4aed5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:18.070680 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-81d02cde-36fd-4f22-83d8-8ae878e4aed5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:18.084773 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-81d02cde-36fd-4f22-83d8-8ae878e4aed5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:18.090600 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-81d02cde-36fd-4f22-83d8-8ae878e4aed5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:18.093388 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-81d02cde-36fd-4f22-83d8-8ae878e4aed5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:18.308652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.network.neutron [None req-7adeaad9-53d7-4237-ab39-380965ae985e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] validate_networks() for [('da70da4e-9138-45ce-9988-0dcf0221903b', None, None, None, None, None)] {{(pid=117797) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:14:18.761525 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-81d02cde-36fd-4f22-83d8-8ae878e4aed5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:18.769523 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-81d02cde-36fd-4f22-83d8-8ae878e4aed5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.722420 Jun 07 13:14:18.770640 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 40/71] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:18 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:18.789335 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-44d0eeb1-a319-4ab9-806c-2689a544389b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:18.798041 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-44d0eeb1-a319-4ab9-806c-2689a544389b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:18.817726 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-44d0eeb1-a319-4ab9-806c-2689a544389b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:18.818179 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-44d0eeb1-a319-4ab9-806c-2689a544389b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:18.818994 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-44d0eeb1-a319-4ab9-806c-2689a544389b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:18.819425 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-44d0eeb1-a319-4ab9-806c-2689a544389b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:19.017029 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-44d0eeb1-a319-4ab9-806c-2689a544389b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:19.024625 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-44d0eeb1-a319-4ab9-806c-2689a544389b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1296 microversion: 2.1 time: 0.253188 Jun 07 13:14:19.025207 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 41/72] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:18 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1296 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:19.029629 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-53ff3e4c-3d80-47a6-82be-c20c9ee744f3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:19.039623 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-53ff3e4c-3d80-47a6-82be-c20c9ee744f3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:19.057971 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53ff3e4c-3d80-47a6-82be-c20c9ee744f3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:19.058406 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53ff3e4c-3d80-47a6-82be-c20c9ee744f3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:19.059217 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53ff3e4c-3d80-47a6-82be-c20c9ee744f3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:19.059640 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53ff3e4c-3d80-47a6-82be-c20c9ee744f3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:19.418254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-53ff3e4c-3d80-47a6-82be-c20c9ee744f3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:19.428733 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-53ff3e4c-3d80-47a6-82be-c20c9ee744f3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1280 microversion: 2.1 time: 0.402068 Jun 07 13:14:19.430110 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 42/73] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:19 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1280 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:19.446790 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f29d3646-6eb0-4884-b93c-0e776f3e4625 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:19.447915 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f29d3646-6eb0-4884-b93c-0e776f3e4625 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:19.456365 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f29d3646-6eb0-4884-b93c-0e776f3e4625 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:19.458065 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f29d3646-6eb0-4884-b93c-0e776f3e4625 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:19.460012 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f29d3646-6eb0-4884-b93c-0e776f3e4625 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:19.460943 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f29d3646-6eb0-4884-b93c-0e776f3e4625 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:19.697688 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f29d3646-6eb0-4884-b93c-0e776f3e4625 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:19.708478 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f29d3646-6eb0-4884-b93c-0e776f3e4625 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.266175 Jun 07 13:14:19.711112 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 43/74] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:19 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:19.791707 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-901a29aa-d5fc-42b2-a97a-ebef5d178538 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:19.792415 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-901a29aa-d5fc-42b2-a97a-ebef5d178538 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:19.803917 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-901a29aa-d5fc-42b2-a97a-ebef5d178538 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:19.804379 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-901a29aa-d5fc-42b2-a97a-ebef5d178538 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:19.805183 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-901a29aa-d5fc-42b2-a97a-ebef5d178538 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:19.805616 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-901a29aa-d5fc-42b2-a97a-ebef5d178538 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:20.229510 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-7adeaad9-53d7-4237-ab39-380965ae985e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Flavor limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:14:20.229940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-7adeaad9-53d7-4237-ab39-380965ae985e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Image limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:14:20.230414 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-7adeaad9-53d7-4237-ab39-380965ae985e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Flavor pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:14:20.230883 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-7adeaad9-53d7-4237-ab39-380965ae985e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Image pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:14:20.231300 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-7adeaad9-53d7-4237-ab39-380965ae985e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:14:20.251981 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7adeaad9-53d7-4237-ab39-380965ae985e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:20.252434 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7adeaad9-53d7-4237-ab39-380965ae985e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:20.253334 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7adeaad9-53d7-4237-ab39-380965ae985e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:20.263537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7adeaad9-53d7-4237-ab39-380965ae985e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:20.362402 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-7adeaad9-53d7-4237-ab39-380965ae985e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Getting quotas for project 1415de13612d47928af70862de8576be. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:14:20.389113 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-7adeaad9-53d7-4237-ab39-380965ae985e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Getting quotas for user c1785cda265641259d831cb0b6a6a34b and project 1415de13612d47928af70862de8576be. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:14:20.454684 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7adeaad9-53d7-4237-ab39-380965ae985e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Going to run 1 instances... {{(pid=117797) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:14:20.458026 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7adeaad9-53d7-4237-ab39-380965ae985e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:14:20.501980 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-901a29aa-d5fc-42b2-a97a-ebef5d178538 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:20.513729 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-901a29aa-d5fc-42b2-a97a-ebef5d178538 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.725527 Jun 07 13:14:20.516998 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 44/75] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:19 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:20.526565 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-107a3954-4294-4661-bdaf-4053275a880f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:20.527182 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-107a3954-4294-4661-bdaf-4053275a880f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:20.547328 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-107a3954-4294-4661-bdaf-4053275a880f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:20.550288 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-107a3954-4294-4661-bdaf-4053275a880f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:20.554072 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-107a3954-4294-4661-bdaf-4053275a880f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:20.554735 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-107a3954-4294-4661-bdaf-4053275a880f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:20.656047 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-7adeaad9-53d7-4237-ab39-380965ae985e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.162323 Jun 07 13:14:20.668170 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 32/76] 10.222.0.58 () {62 vars in 1187 bytes} [Tue Jun 7 13:14:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 3175 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 13:14:20.673971 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-cba4674f-a7da-49cb-a36f-ae41e8e679a5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:20.704586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-cba4674f-a7da-49cb-a36f-ae41e8e679a5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:20.730019 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cba4674f-a7da-49cb-a36f-ae41e8e679a5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:20.730501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cba4674f-a7da-49cb-a36f-ae41e8e679a5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:20.736596 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cba4674f-a7da-49cb-a36f-ae41e8e679a5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:20.737127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cba4674f-a7da-49cb-a36f-ae41e8e679a5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:20.865309 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-107a3954-4294-4661-bdaf-4053275a880f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:20.876820 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-107a3954-4294-4661-bdaf-4053275a880f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1296 microversion: 2.1 time: 0.356204 Jun 07 13:14:20.878719 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 45/77] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:20 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1296 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:21.097234 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-e466b989-a98a-4b2a-ad94-576643e84e54 req-a05d5bde-ed7b-467d-979c-e218e0c3ee7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0", "tag": "fa01f4c1-c3a7-4d48-95e4-fa07833fc0cc"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:21.114860 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-e466b989-a98a-4b2a-ad94-576643e84e54 req-a05d5bde-ed7b-467d-979c-e218e0c3ee7e service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:21.116577 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-e466b989-a98a-4b2a-ad94-576643e84e54 req-a05d5bde-ed7b-467d-979c-e218e0c3ee7e service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:21.146587 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-e466b989-a98a-4b2a-ad94-576643e84e54 req-a05d5bde-ed7b-467d-979c-e218e0c3ee7e service nova] Creating event network-changed:fa01f4c1-c3a7-4d48-95e4-fa07833fc0cc for instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 on hv-cinder-84496 Jun 07 13:14:21.164817 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-e466b989-a98a-4b2a-ad94-576643e84e54 req-a05d5bde-ed7b-467d-979c-e218e0c3ee7e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.284482 Jun 07 13:14:21.165646 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 46/78] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:14:21.173178 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ec7dd211-6c3a-4ad8-9d04-a6e6cb71e8c1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:21.174310 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ec7dd211-6c3a-4ad8-9d04-a6e6cb71e8c1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:21.332769 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cba4674f-a7da-49cb-a36f-ae41e8e679a5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:21.340520 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-cba4674f-a7da-49cb-a36f-ae41e8e679a5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.670958 Jun 07 13:14:21.349963 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 33/79] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:20 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:21.354977 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-05f68cde-af6c-45ce-a4ef-a1ecefb68c32 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:21.355594 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-05f68cde-af6c-45ce-a4ef-a1ecefb68c32 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:21.363050 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-05f68cde-af6c-45ce-a4ef-a1ecefb68c32 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:21.363507 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-05f68cde-af6c-45ce-a4ef-a1ecefb68c32 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:21.364278 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-05f68cde-af6c-45ce-a4ef-a1ecefb68c32 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:21.364711 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-05f68cde-af6c-45ce-a4ef-a1ecefb68c32 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:21.541681 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ec7dd211-6c3a-4ad8-9d04-a6e6cb71e8c1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:21.550540 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ec7dd211-6c3a-4ad8-9d04-a6e6cb71e8c1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:21.552336 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ec7dd211-6c3a-4ad8-9d04-a6e6cb71e8c1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:21.556030 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ec7dd211-6c3a-4ad8-9d04-a6e6cb71e8c1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1281 microversion: 2.20 time: 0.388761 Jun 07 13:14:21.557798 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 47/80] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:21 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1281 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:21.874691 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-27d15770-fb5a-4878-8182-91ac9b658ac8 req-e2709159-1af1-4a0e-a09a-a48c97c6b1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78e5cc8-7238-4286-aae7-13544b3bcb99", "name": "network-vif-plugged", "status": "completed", "tag": "72137dbd-ac58-46a3-a21f-b1f0720047f9"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:21.892544 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-27d15770-fb5a-4878-8182-91ac9b658ac8 req-e2709159-1af1-4a0e-a09a-a48c97c6b1f7 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:21.892897 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-27d15770-fb5a-4878-8182-91ac9b658ac8 req-e2709159-1af1-4a0e-a09a-a48c97c6b1f7 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:21.918611 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-27d15770-fb5a-4878-8182-91ac9b658ac8 req-e2709159-1af1-4a0e-a09a-a48c97c6b1f7 service nova] Creating event network-vif-plugged:72137dbd-ac58-46a3-a21f-b1f0720047f9 for instance c78e5cc8-7238-4286-aae7-13544b3bcb99 on hv-cinder-84496 Jun 07 13:14:21.930883 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-27d15770-fb5a-4878-8182-91ac9b658ac8 req-e2709159-1af1-4a0e-a09a-a48c97c6b1f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.365980 Jun 07 13:14:21.931763 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 48/81] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:14:21.937689 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ed5f7a2a-2c90-4259-8c7a-b1ab51222441 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:21.938396 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ed5f7a2a-2c90-4259-8c7a-b1ab51222441 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:21.964379 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed5f7a2a-2c90-4259-8c7a-b1ab51222441 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:21.965056 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed5f7a2a-2c90-4259-8c7a-b1ab51222441 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:21.966004 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed5f7a2a-2c90-4259-8c7a-b1ab51222441 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:21.966637 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed5f7a2a-2c90-4259-8c7a-b1ab51222441 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:22.244943 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-05f68cde-af6c-45ce-a4ef-a1ecefb68c32 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:22.260015 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-05f68cde-af6c-45ce-a4ef-a1ecefb68c32 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.908628 Jun 07 13:14:22.261952 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 34/82] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:21 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:22.273447 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b5136857-372e-4762-81c6-31e8fbf941ce tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:22.274745 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b5136857-372e-4762-81c6-31e8fbf941ce tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:22.281893 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b5136857-372e-4762-81c6-31e8fbf941ce tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:22.282664 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b5136857-372e-4762-81c6-31e8fbf941ce tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:22.283908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b5136857-372e-4762-81c6-31e8fbf941ce tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:22.284532 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b5136857-372e-4762-81c6-31e8fbf941ce tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:22.388646 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ed5f7a2a-2c90-4259-8c7a-b1ab51222441 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:22.397504 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ed5f7a2a-2c90-4259-8c7a-b1ab51222441 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.464467 Jun 07 13:14:22.408284 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 49/83] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:21 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:22.414040 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-098a51a0-cb56-4987-a630-ebaac6db3168 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:22.414823 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-098a51a0-cb56-4987-a630-ebaac6db3168 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:22.423809 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-098a51a0-cb56-4987-a630-ebaac6db3168 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:22.424512 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-098a51a0-cb56-4987-a630-ebaac6db3168 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:22.425634 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-098a51a0-cb56-4987-a630-ebaac6db3168 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:22.426316 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-098a51a0-cb56-4987-a630-ebaac6db3168 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:22.460587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b5136857-372e-4762-81c6-31e8fbf941ce tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:22.469470 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b5136857-372e-4762-81c6-31e8fbf941ce tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.201222 Jun 07 13:14:22.480276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 35/84] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:22 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:22.577471 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-18e3fcc9-9e64-43eb-beeb-180572dde52b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:22.578287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-18e3fcc9-9e64-43eb-beeb-180572dde52b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:22.584822 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-18e3fcc9-9e64-43eb-beeb-180572dde52b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:22.585372 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-18e3fcc9-9e64-43eb-beeb-180572dde52b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:22.586362 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-18e3fcc9-9e64-43eb-beeb-180572dde52b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:22.586933 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-18e3fcc9-9e64-43eb-beeb-180572dde52b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:22.661532 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-18e3fcc9-9e64-43eb-beeb-180572dde52b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:22.671762 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-18e3fcc9-9e64-43eb-beeb-180572dde52b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:22.675577 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-18e3fcc9-9e64-43eb-beeb-180572dde52b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:22.675577 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-18e3fcc9-9e64-43eb-beeb-180572dde52b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1333 microversion: 2.20 time: 0.101943 Jun 07 13:14:22.675577 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 36/85] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:22 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1333 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:22.729908 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-098a51a0-cb56-4987-a630-ebaac6db3168 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:22.738914 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-098a51a0-cb56-4987-a630-ebaac6db3168 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.328990 Jun 07 13:14:22.739667 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 50/86] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:22 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:22.785460 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-1e91b3e7-6066-4871-a447-f7cc2220f8b7 req-34672384-df7d-4aa2-986d-2b800baa91cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972b9306-4700-4212-ba99-0654d90e4348", "tag": "46af4bbe-8074-4168-ad35-f13ba7b7a236"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:22.797688 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-1e91b3e7-6066-4871-a447-f7cc2220f8b7 req-34672384-df7d-4aa2-986d-2b800baa91cc service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:22.798563 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-1e91b3e7-6066-4871-a447-f7cc2220f8b7 req-34672384-df7d-4aa2-986d-2b800baa91cc service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:22.820566 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-1e91b3e7-6066-4871-a447-f7cc2220f8b7 req-34672384-df7d-4aa2-986d-2b800baa91cc service nova] Creating event network-changed:46af4bbe-8074-4168-ad35-f13ba7b7a236 for instance 972b9306-4700-4212-ba99-0654d90e4348 on hv-cinder-84496 Jun 07 13:14:22.820699 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-1e91b3e7-6066-4871-a447-f7cc2220f8b7 req-34672384-df7d-4aa2-986d-2b800baa91cc service nova] Acquired lock "compute-rpcapi-router" {{(pid=117797) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 13:14:22.822982 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-190d206c-4ff7-4c10-a186-dbd367ab95ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:22.823821 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-190d206c-4ff7-4c10-a186-dbd367ab95ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:22.824802 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-190d206c-4ff7-4c10-a186-dbd367ab95ee None None] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:22.825556 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-190d206c-4ff7-4c10-a186-dbd367ab95ee None None] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:22.835512 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.compute.rpcapi [None req-190d206c-4ff7-4c10-a186-dbd367ab95ee None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 13:14:22.836506 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-190d206c-4ff7-4c10-a186-dbd367ab95ee None None] Releasing lock "compute-rpcapi-router" {{(pid=117797) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 13:14:22.875572 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-190d206c-4ff7-4c10-a186-dbd367ab95ee None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093894 Jun 07 13:14:22.877753 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 37/87] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:14:23.277037 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a3f60c3e-d877-4896-9db3-85df3e5431a2 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:23.277562 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a3f60c3e-d877-4896-9db3-85df3e5431a2 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:23.282186 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=4 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:23.289215 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a3f60c3e-d877-4896-9db3-85df3e5431a2 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:23.289606 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a3f60c3e-d877-4896-9db3-85df3e5431a2 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:23.290389 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a3f60c3e-d877-4896-9db3-85df3e5431a2 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:23.296594 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a3f60c3e-d877-4896-9db3-85df3e5431a2 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:23.419296 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-822d9b10-46aa-4324-a24c-70269f36367c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:23.421506 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-822d9b10-46aa-4324-a24c-70269f36367c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:23.429485 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-822d9b10-46aa-4324-a24c-70269f36367c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:23.429933 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-822d9b10-46aa-4324-a24c-70269f36367c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:23.431021 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-822d9b10-46aa-4324-a24c-70269f36367c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:23.431613 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-822d9b10-46aa-4324-a24c-70269f36367c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:23.440854 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a3f60c3e-d877-4896-9db3-85df3e5431a2 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:23.449095 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a3f60c3e-d877-4896-9db3-85df3e5431a2 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.175912 Jun 07 13:14:23.449677 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 51/88] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:23 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:23.486967 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-48b47399-b6e8-4aad-b75d-068ae4417aa4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:23.487583 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-48b47399-b6e8-4aad-b75d-068ae4417aa4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:23.497781 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-48b47399-b6e8-4aad-b75d-068ae4417aa4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:23.498303 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-48b47399-b6e8-4aad-b75d-068ae4417aa4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:23.499380 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-48b47399-b6e8-4aad-b75d-068ae4417aa4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:23.499906 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-48b47399-b6e8-4aad-b75d-068ae4417aa4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:23.583318 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-822d9b10-46aa-4324-a24c-70269f36367c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:23.593855 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-822d9b10-46aa-4324-a24c-70269f36367c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.181519 Jun 07 13:14:23.595124 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 38/89] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:23 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:23.654655 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-48b47399-b6e8-4aad-b75d-068ae4417aa4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:23.663070 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-48b47399-b6e8-4aad-b75d-068ae4417aa4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.180643 Jun 07 13:14:23.663675 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 52/90] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:23 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:23.695442 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3a3f3a5e-ab01-4bd2-9fed-2455091292e3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:23.696266 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3a3f3a5e-ab01-4bd2-9fed-2455091292e3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:23.702917 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3a3f3a5e-ab01-4bd2-9fed-2455091292e3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:23.703359 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3a3f3a5e-ab01-4bd2-9fed-2455091292e3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:23.704152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3a3f3a5e-ab01-4bd2-9fed-2455091292e3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:23.704722 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3a3f3a5e-ab01-4bd2-9fed-2455091292e3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:23.756209 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c472c983-3a5b-4fb5-8f0b-cc9633f45726 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:23.756810 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c472c983-3a5b-4fb5-8f0b-cc9633f45726 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:23.764387 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c472c983-3a5b-4fb5-8f0b-cc9633f45726 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:23.764841 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c472c983-3a5b-4fb5-8f0b-cc9633f45726 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:23.765608 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c472c983-3a5b-4fb5-8f0b-cc9633f45726 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:23.766041 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c472c983-3a5b-4fb5-8f0b-cc9633f45726 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:23.778468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3a3f3a5e-ab01-4bd2-9fed-2455091292e3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:23.790750 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3a3f3a5e-ab01-4bd2-9fed-2455091292e3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:23.792392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3a3f3a5e-ab01-4bd2-9fed-2455091292e3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:23.793593 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3a3f3a5e-ab01-4bd2-9fed-2455091292e3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1333 microversion: 2.20 time: 0.104443 Jun 07 13:14:23.794274 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 39/91] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:23 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1333 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:23.904533 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c472c983-3a5b-4fb5-8f0b-cc9633f45726 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:23.907418 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:23.914393 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c472c983-3a5b-4fb5-8f0b-cc9633f45726 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.162094 Jun 07 13:14:23.914990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 53/92] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:23 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:24.465957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-6f0e40b1-8b3b-49b1-a1da-d2bc477236cb tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:24.466513 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-6f0e40b1-8b3b-49b1-a1da-d2bc477236cb tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:24.472448 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6f0e40b1-8b3b-49b1-a1da-d2bc477236cb tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:24.472899 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6f0e40b1-8b3b-49b1-a1da-d2bc477236cb tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:24.473647 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6f0e40b1-8b3b-49b1-a1da-d2bc477236cb tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:24.474081 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6f0e40b1-8b3b-49b1-a1da-d2bc477236cb tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:24.599137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-6f0e40b1-8b3b-49b1-a1da-d2bc477236cb tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:24.606510 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-6f0e40b1-8b3b-49b1-a1da-d2bc477236cb tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.144380 Jun 07 13:14:24.607079 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 40/93] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:24 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:24.611871 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d4af38b2-2405-4cf5-8a5b-ceddb94dc3ea tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:24.612508 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d4af38b2-2405-4cf5-8a5b-ceddb94dc3ea tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:24.618780 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d4af38b2-2405-4cf5-8a5b-ceddb94dc3ea tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:24.619265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d4af38b2-2405-4cf5-8a5b-ceddb94dc3ea tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:24.620286 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d4af38b2-2405-4cf5-8a5b-ceddb94dc3ea tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:24.620481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d4af38b2-2405-4cf5-8a5b-ceddb94dc3ea tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:24.681114 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-267d856d-228f-469d-a03e-54ad410de012 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:24.681720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-267d856d-228f-469d-a03e-54ad410de012 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:24.688227 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-267d856d-228f-469d-a03e-54ad410de012 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:24.688676 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-267d856d-228f-469d-a03e-54ad410de012 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:24.689438 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-267d856d-228f-469d-a03e-54ad410de012 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:24.690107 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-267d856d-228f-469d-a03e-54ad410de012 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:24.753762 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d4af38b2-2405-4cf5-8a5b-ceddb94dc3ea tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:24.762194 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d4af38b2-2405-4cf5-8a5b-ceddb94dc3ea tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.154539 Jun 07 13:14:24.763007 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 54/94] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:24 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:24.813299 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-55a4d057-3993-4dba-b2ba-06007949a49c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:24.813912 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-55a4d057-3993-4dba-b2ba-06007949a49c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:24.819931 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-55a4d057-3993-4dba-b2ba-06007949a49c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:24.820382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-55a4d057-3993-4dba-b2ba-06007949a49c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:24.821147 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-55a4d057-3993-4dba-b2ba-06007949a49c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:24.821582 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-55a4d057-3993-4dba-b2ba-06007949a49c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:24.821671 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-267d856d-228f-469d-a03e-54ad410de012 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:24.841494 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-267d856d-228f-469d-a03e-54ad410de012 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.163771 Jun 07 13:14:24.842675 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 41/95] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:24 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:24.895811 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-55a4d057-3993-4dba-b2ba-06007949a49c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:24.896115 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-bae463bf-df2b-41fd-98d6-2c9f794b4c2e req-cf83f8c2-adb7-4c9c-bc3c-7265177ed4ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0925b3-d41e-4935-abb7-e3566d134f26", "tag": "2fe156ca-e8ed-44a1-9a93-c8bcc91216e2"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:24.903755 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-55a4d057-3993-4dba-b2ba-06007949a49c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:24.903971 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-bae463bf-df2b-41fd-98d6-2c9f794b4c2e req-cf83f8c2-adb7-4c9c-bc3c-7265177ed4ef service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:24.904405 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-bae463bf-df2b-41fd-98d6-2c9f794b4c2e req-cf83f8c2-adb7-4c9c-bc3c-7265177ed4ef service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:24.905301 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-55a4d057-3993-4dba-b2ba-06007949a49c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:24.906398 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-55a4d057-3993-4dba-b2ba-06007949a49c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1333 microversion: 2.20 time: 0.097525 Jun 07 13:14:24.906972 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 55/96] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:24 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1333 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:14:24.915367 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-bae463bf-df2b-41fd-98d6-2c9f794b4c2e req-cf83f8c2-adb7-4c9c-bc3c-7265177ed4ef service nova] Creating event network-changed:2fe156ca-e8ed-44a1-9a93-c8bcc91216e2 for instance 8d0925b3-d41e-4935-abb7-e3566d134f26 on hv-cinder-84496 Jun 07 13:14:24.920125 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-bae463bf-df2b-41fd-98d6-2c9f794b4c2e req-cf83f8c2-adb7-4c9c-bc3c-7265177ed4ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027628 Jun 07 13:14:24.921211 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 42/97] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:14:24.930170 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8fa13c29-5caf-49c1-9f8e-02d94772b76b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:24.930832 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8fa13c29-5caf-49c1-9f8e-02d94772b76b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:24.937503 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8fa13c29-5caf-49c1-9f8e-02d94772b76b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:24.937951 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8fa13c29-5caf-49c1-9f8e-02d94772b76b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:24.938773 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8fa13c29-5caf-49c1-9f8e-02d94772b76b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:24.939214 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8fa13c29-5caf-49c1-9f8e-02d94772b76b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:25.069448 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8fa13c29-5caf-49c1-9f8e-02d94772b76b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:25.077078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8fa13c29-5caf-49c1-9f8e-02d94772b76b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.150674 Jun 07 13:14:25.077985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 56/98] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:24 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:25.623921 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5a0957ce-f067-4e69-a4cc-8eae57d4bca9 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:25.624624 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5a0957ce-f067-4e69-a4cc-8eae57d4bca9 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:25.631432 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5a0957ce-f067-4e69-a4cc-8eae57d4bca9 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:25.631887 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5a0957ce-f067-4e69-a4cc-8eae57d4bca9 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:25.632816 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5a0957ce-f067-4e69-a4cc-8eae57d4bca9 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:25.633283 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5a0957ce-f067-4e69-a4cc-8eae57d4bca9 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:25.779422 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-06e565f6-e81a-4bb0-9e3a-c0e47bbc2d95 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:25.780583 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-06e565f6-e81a-4bb0-9e3a-c0e47bbc2d95 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:25.788654 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-06e565f6-e81a-4bb0-9e3a-c0e47bbc2d95 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:25.789113 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-06e565f6-e81a-4bb0-9e3a-c0e47bbc2d95 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:25.789887 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-06e565f6-e81a-4bb0-9e3a-c0e47bbc2d95 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:25.790329 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-06e565f6-e81a-4bb0-9e3a-c0e47bbc2d95 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:25.878899 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5a0957ce-f067-4e69-a4cc-8eae57d4bca9 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:25.886743 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5a0957ce-f067-4e69-a4cc-8eae57d4bca9 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.267049 Jun 07 13:14:25.892199 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 43/99] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:25 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:25.896913 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1e938e95-ca8b-4390-b756-8a2d9b3a86be tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:25.897531 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1e938e95-ca8b-4390-b756-8a2d9b3a86be tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:25.920585 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1e938e95-ca8b-4390-b756-8a2d9b3a86be tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:25.921041 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1e938e95-ca8b-4390-b756-8a2d9b3a86be tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:25.921817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1e938e95-ca8b-4390-b756-8a2d9b3a86be tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:25.922252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1e938e95-ca8b-4390-b756-8a2d9b3a86be tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:25.991271 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-06e565f6-e81a-4bb0-9e3a-c0e47bbc2d95 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:26.000922 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-06e565f6-e81a-4bb0-9e3a-c0e47bbc2d95 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.224963 Jun 07 13:14:26.002132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 57/100] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:25 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:26.008176 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bb44c22f-374b-4136-b4ac-eaaac7fbf87b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:26.008899 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bb44c22f-374b-4136-b4ac-eaaac7fbf87b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:26.026008 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb44c22f-374b-4136-b4ac-eaaac7fbf87b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:26.028450 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb44c22f-374b-4136-b4ac-eaaac7fbf87b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:26.029304 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb44c22f-374b-4136-b4ac-eaaac7fbf87b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:26.030262 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb44c22f-374b-4136-b4ac-eaaac7fbf87b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:26.118075 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bb44c22f-374b-4136-b4ac-eaaac7fbf87b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:26.127925 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bb44c22f-374b-4136-b4ac-eaaac7fbf87b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:26.129512 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bb44c22f-374b-4136-b4ac-eaaac7fbf87b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:26.130623 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bb44c22f-374b-4136-b4ac-eaaac7fbf87b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1333 microversion: 2.20 time: 0.127262 Jun 07 13:14:26.131445 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 58/101] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:26 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1333 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:26.144052 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-20686575-a40f-4142-ba45-0c634538a0a7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:26.145047 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-20686575-a40f-4142-ba45-0c634538a0a7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:26.152916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20686575-a40f-4142-ba45-0c634538a0a7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:26.153486 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20686575-a40f-4142-ba45-0c634538a0a7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:26.155407 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20686575-a40f-4142-ba45-0c634538a0a7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:26.155915 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20686575-a40f-4142-ba45-0c634538a0a7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:26.189012 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1e938e95-ca8b-4390-b756-8a2d9b3a86be tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:26.191484 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:26.204651 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1e938e95-ca8b-4390-b756-8a2d9b3a86be tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.310687 Jun 07 13:14:26.205253 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 44/102] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:25 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:26.220383 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-0a17ab2a-5e2b-4c63-8a85-2d3707d491c5 req-b4d57159-f891-4dac-bb94-2941a7edd168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec72c48-4900-4d75-8fca-c5b6f5a287ca", "tag": "58128dcd-c6cf-4bd6-852b-7f5930478fbf"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:26.228914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-0a17ab2a-5e2b-4c63-8a85-2d3707d491c5 req-b4d57159-f891-4dac-bb94-2941a7edd168 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:26.229239 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-0a17ab2a-5e2b-4c63-8a85-2d3707d491c5 req-b4d57159-f891-4dac-bb94-2941a7edd168 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:26.244555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-0a17ab2a-5e2b-4c63-8a85-2d3707d491c5 req-b4d57159-f891-4dac-bb94-2941a7edd168 service nova] Creating event network-changed:58128dcd-c6cf-4bd6-852b-7f5930478fbf for instance dec72c48-4900-4d75-8fca-c5b6f5a287ca on hv-cinder-84496 Jun 07 13:14:26.252639 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-0a17ab2a-5e2b-4c63-8a85-2d3707d491c5 req-b4d57159-f891-4dac-bb94-2941a7edd168 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036481 Jun 07 13:14:26.253736 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 45/103] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:14:26.325569 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-20686575-a40f-4142-ba45-0c634538a0a7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:26.334066 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-20686575-a40f-4142-ba45-0c634538a0a7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.198053 Jun 07 13:14:26.334648 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 59/104] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:26 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:26.904135 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8ef655d4-37c0-47a2-8647-987e8b33fed5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:26.904908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8ef655d4-37c0-47a2-8647-987e8b33fed5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:26.911047 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8ef655d4-37c0-47a2-8647-987e8b33fed5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:26.911501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8ef655d4-37c0-47a2-8647-987e8b33fed5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:26.912521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8ef655d4-37c0-47a2-8647-987e8b33fed5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:26.912968 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8ef655d4-37c0-47a2-8647-987e8b33fed5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:27.019577 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e5c763c7-4306-4b32-ad88-f5e212058c9f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:27.019577 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e5c763c7-4306-4b32-ad88-f5e212058c9f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:27.025319 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5c763c7-4306-4b32-ad88-f5e212058c9f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:27.025768 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5c763c7-4306-4b32-ad88-f5e212058c9f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:27.026556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5c763c7-4306-4b32-ad88-f5e212058c9f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:27.026997 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5c763c7-4306-4b32-ad88-f5e212058c9f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:27.064161 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8ef655d4-37c0-47a2-8647-987e8b33fed5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:27.073154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8ef655d4-37c0-47a2-8647-987e8b33fed5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.173120 Jun 07 13:14:27.074013 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 46/105] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:26 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:27.149563 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f92835a0-0878-4b03-8730-d8c3adc07e56 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:27.150952 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f92835a0-0878-4b03-8730-d8c3adc07e56 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:27.157890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f92835a0-0878-4b03-8730-d8c3adc07e56 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:27.158400 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f92835a0-0878-4b03-8730-d8c3adc07e56 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:27.159428 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f92835a0-0878-4b03-8730-d8c3adc07e56 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:27.160012 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f92835a0-0878-4b03-8730-d8c3adc07e56 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:27.174353 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e5c763c7-4306-4b32-ad88-f5e212058c9f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:27.183331 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e5c763c7-4306-4b32-ad88-f5e212058c9f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.169155 Jun 07 13:14:27.193453 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 60/106] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:27 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:27.222632 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-59247572-95f4-461b-8418-f889ba840f1f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:27.223415 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-59247572-95f4-461b-8418-f889ba840f1f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:27.224676 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f92835a0-0878-4b03-8730-d8c3adc07e56 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:27.229544 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-59247572-95f4-461b-8418-f889ba840f1f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:27.230005 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-59247572-95f4-461b-8418-f889ba840f1f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:27.230967 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-59247572-95f4-461b-8418-f889ba840f1f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:27.231406 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-59247572-95f4-461b-8418-f889ba840f1f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:27.233869 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f92835a0-0878-4b03-8730-d8c3adc07e56 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:27.235518 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f92835a0-0878-4b03-8730-d8c3adc07e56 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:27.236698 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f92835a0-0878-4b03-8730-d8c3adc07e56 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1333 microversion: 2.20 time: 0.091483 Jun 07 13:14:27.237692 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 47/107] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:27 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:27.351259 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9999743f-b6d0-41bc-93eb-d57f2eede9b3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:27.352007 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9999743f-b6d0-41bc-93eb-d57f2eede9b3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:27.361013 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9999743f-b6d0-41bc-93eb-d57f2eede9b3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:27.361719 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9999743f-b6d0-41bc-93eb-d57f2eede9b3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:27.362672 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9999743f-b6d0-41bc-93eb-d57f2eede9b3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:27.363202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9999743f-b6d0-41bc-93eb-d57f2eede9b3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:27.371758 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-59247572-95f4-461b-8418-f889ba840f1f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:27.385504 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-59247572-95f4-461b-8418-f889ba840f1f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.161248 Jun 07 13:14:27.388883 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 61/108] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:27 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:27.493192 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9999743f-b6d0-41bc-93eb-d57f2eede9b3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:27.500557 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9999743f-b6d0-41bc-93eb-d57f2eede9b3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.153070 Jun 07 13:14:27.501125 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 48/109] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:27 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:28.089796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cda82b66-6229-4f60-b3f6-dcdf069c3d28 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:28.090477 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cda82b66-6229-4f60-b3f6-dcdf069c3d28 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:28.096448 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cda82b66-6229-4f60-b3f6-dcdf069c3d28 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:28.096888 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cda82b66-6229-4f60-b3f6-dcdf069c3d28 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:28.097649 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cda82b66-6229-4f60-b3f6-dcdf069c3d28 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:28.098080 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cda82b66-6229-4f60-b3f6-dcdf069c3d28 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:28.201481 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-93d09b49-5d12-4408-8926-cf282125fb04 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:28.202823 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-93d09b49-5d12-4408-8926-cf282125fb04 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:28.209152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-93d09b49-5d12-4408-8926-cf282125fb04 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:28.209681 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-93d09b49-5d12-4408-8926-cf282125fb04 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:28.210548 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-93d09b49-5d12-4408-8926-cf282125fb04 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:28.210980 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-93d09b49-5d12-4408-8926-cf282125fb04 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:28.228733 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cda82b66-6229-4f60-b3f6-dcdf069c3d28 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:28.236851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cda82b66-6229-4f60-b3f6-dcdf069c3d28 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.150795 Jun 07 13:14:28.237450 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 62/110] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:28 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:28.255934 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1cfd7e4c-eb49-41ea-9636-09c49c4276a7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:28.256739 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1cfd7e4c-eb49-41ea-9636-09c49c4276a7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:28.263464 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1cfd7e4c-eb49-41ea-9636-09c49c4276a7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:28.263912 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1cfd7e4c-eb49-41ea-9636-09c49c4276a7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:28.265371 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1cfd7e4c-eb49-41ea-9636-09c49c4276a7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:28.265815 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1cfd7e4c-eb49-41ea-9636-09c49c4276a7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:28.333901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1cfd7e4c-eb49-41ea-9636-09c49c4276a7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:28.342808 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1cfd7e4c-eb49-41ea-9636-09c49c4276a7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:28.344264 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1cfd7e4c-eb49-41ea-9636-09c49c4276a7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:28.346264 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1cfd7e4c-eb49-41ea-9636-09c49c4276a7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1333 microversion: 2.20 time: 0.093640 Jun 07 13:14:28.346264 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 63/111] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:28 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:28.396493 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d7bd974a-697c-43ff-8db7-c6807007a221 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:28.397226 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d7bd974a-697c-43ff-8db7-c6807007a221 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:28.403385 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d7bd974a-697c-43ff-8db7-c6807007a221 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:28.403908 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d7bd974a-697c-43ff-8db7-c6807007a221 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:28.404810 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d7bd974a-697c-43ff-8db7-c6807007a221 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:28.405318 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d7bd974a-697c-43ff-8db7-c6807007a221 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:28.484165 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-93d09b49-5d12-4408-8926-cf282125fb04 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:28.491590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-93d09b49-5d12-4408-8926-cf282125fb04 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.294166 Jun 07 13:14:28.492159 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 49/112] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:28 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:28.516828 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3727f562-01ab-442f-b4f3-c158b950806e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:28.517540 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3727f562-01ab-442f-b4f3-c158b950806e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:28.523570 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3727f562-01ab-442f-b4f3-c158b950806e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:28.524016 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3727f562-01ab-442f-b4f3-c158b950806e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:28.524785 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3727f562-01ab-442f-b4f3-c158b950806e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:28.525222 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3727f562-01ab-442f-b4f3-c158b950806e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:28.533742 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d7bd974a-697c-43ff-8db7-c6807007a221 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:28.541587 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d7bd974a-697c-43ff-8db7-c6807007a221 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.149176 Jun 07 13:14:28.542176 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 64/113] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:28 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:28.656882 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3727f562-01ab-442f-b4f3-c158b950806e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:28.664533 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3727f562-01ab-442f-b4f3-c158b950806e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.151480 Jun 07 13:14:28.665101 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 50/114] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:28 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:29.253619 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8889ee5f-440b-49b0-b8a9-c21fdb38db0a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:29.254233 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8889ee5f-440b-49b0-b8a9-c21fdb38db0a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:29.260388 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8889ee5f-440b-49b0-b8a9-c21fdb38db0a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:29.260835 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8889ee5f-440b-49b0-b8a9-c21fdb38db0a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:29.261596 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8889ee5f-440b-49b0-b8a9-c21fdb38db0a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:29.262029 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8889ee5f-440b-49b0-b8a9-c21fdb38db0a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:29.363549 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8acc5bcf-abcb-44e3-b431-377df2147fed tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:29.364272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8acc5bcf-abcb-44e3-b431-377df2147fed tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:29.370228 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8acc5bcf-abcb-44e3-b431-377df2147fed tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:29.370696 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8acc5bcf-abcb-44e3-b431-377df2147fed tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:29.371446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8acc5bcf-abcb-44e3-b431-377df2147fed tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:29.371879 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8acc5bcf-abcb-44e3-b431-377df2147fed tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:29.391603 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8889ee5f-440b-49b0-b8a9-c21fdb38db0a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:29.400024 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8889ee5f-440b-49b0-b8a9-c21fdb38db0a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.150172 Jun 07 13:14:29.400692 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 65/115] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:29 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:29.431426 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8acc5bcf-abcb-44e3-b431-377df2147fed tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:29.439146 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8acc5bcf-abcb-44e3-b431-377df2147fed tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:29.440650 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8acc5bcf-abcb-44e3-b431-377df2147fed tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:29.441736 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8acc5bcf-abcb-44e3-b431-377df2147fed tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1333 microversion: 2.20 time: 0.082027 Jun 07 13:14:29.442277 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 51/116] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:29 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1333 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:14:29.508185 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-762e4c69-c09f-44da-aeb2-763a6a5ed19e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:29.508729 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-762e4c69-c09f-44da-aeb2-763a6a5ed19e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:29.515212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-762e4c69-c09f-44da-aeb2-763a6a5ed19e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:29.515654 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-762e4c69-c09f-44da-aeb2-763a6a5ed19e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:29.516404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-762e4c69-c09f-44da-aeb2-763a6a5ed19e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:29.516838 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-762e4c69-c09f-44da-aeb2-763a6a5ed19e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:29.559344 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3533efc5-8dac-4d81-9974-f1aca40bca4d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:29.559945 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3533efc5-8dac-4d81-9974-f1aca40bca4d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:29.566282 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3533efc5-8dac-4d81-9974-f1aca40bca4d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:29.566755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3533efc5-8dac-4d81-9974-f1aca40bca4d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:29.567510 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3533efc5-8dac-4d81-9974-f1aca40bca4d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:29.567938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3533efc5-8dac-4d81-9974-f1aca40bca4d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:29.649216 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-762e4c69-c09f-44da-aeb2-763a6a5ed19e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:29.656956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-762e4c69-c09f-44da-aeb2-763a6a5ed19e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.152593 Jun 07 13:14:29.657532 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 66/117] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:29 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:29.680904 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1aec98ec-089d-4ed5-8ee1-da4e763e35bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:29.681617 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1aec98ec-089d-4ed5-8ee1-da4e763e35bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:29.688490 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1aec98ec-089d-4ed5-8ee1-da4e763e35bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:29.689058 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1aec98ec-089d-4ed5-8ee1-da4e763e35bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:29.689903 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1aec98ec-089d-4ed5-8ee1-da4e763e35bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:29.690343 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1aec98ec-089d-4ed5-8ee1-da4e763e35bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:29.700269 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3533efc5-8dac-4d81-9974-f1aca40bca4d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:29.708241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3533efc5-8dac-4d81-9974-f1aca40bca4d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.152613 Jun 07 13:14:29.708803 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 52/118] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:29 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:29.817353 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1aec98ec-089d-4ed5-8ee1-da4e763e35bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:29.824830 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1aec98ec-089d-4ed5-8ee1-da4e763e35bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.147681 Jun 07 13:14:29.825410 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 67/119] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:29 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:30.417080 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7aed302c-1fbf-4d3f-b5ba-4f22eb8da3db tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:30.417785 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7aed302c-1fbf-4d3f-b5ba-4f22eb8da3db tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:30.424476 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7aed302c-1fbf-4d3f-b5ba-4f22eb8da3db tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:30.424929 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7aed302c-1fbf-4d3f-b5ba-4f22eb8da3db tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:30.425696 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7aed302c-1fbf-4d3f-b5ba-4f22eb8da3db tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:30.426137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7aed302c-1fbf-4d3f-b5ba-4f22eb8da3db tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:30.440468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=30 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:30.459289 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e4847efb-9c96-428c-91ec-2488a027daf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:30.460015 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e4847efb-9c96-428c-91ec-2488a027daf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:30.466468 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e4847efb-9c96-428c-91ec-2488a027daf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:30.466934 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e4847efb-9c96-428c-91ec-2488a027daf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:30.467703 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e4847efb-9c96-428c-91ec-2488a027daf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:30.468134 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e4847efb-9c96-428c-91ec-2488a027daf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:30.530624 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e4847efb-9c96-428c-91ec-2488a027daf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:30.539267 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e4847efb-9c96-428c-91ec-2488a027daf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:30.540764 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e4847efb-9c96-428c-91ec-2488a027daf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:30.541845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e4847efb-9c96-428c-91ec-2488a027daf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1333 microversion: 2.20 time: 0.086403 Jun 07 13:14:30.542401 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 68/120] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:30 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:14:30.557123 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-7aed302c-1fbf-4d3f-b5ba-4f22eb8da3db tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:30.564485 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-7aed302c-1fbf-4d3f-b5ba-4f22eb8da3db tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.151186 Jun 07 13:14:30.565045 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 53/121] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:30 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:30.673205 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-22028aca-566d-474a-a4f2-7fedb591a1c7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:30.673820 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-22028aca-566d-474a-a4f2-7fedb591a1c7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:30.679733 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-22028aca-566d-474a-a4f2-7fedb591a1c7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:30.680181 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-22028aca-566d-474a-a4f2-7fedb591a1c7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:30.680965 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-22028aca-566d-474a-a4f2-7fedb591a1c7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:30.681401 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-22028aca-566d-474a-a4f2-7fedb591a1c7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:30.725580 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a31b69c7-7706-4831-90e0-b877935926a8 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:30.726321 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a31b69c7-7706-4831-90e0-b877935926a8 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:30.732518 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a31b69c7-7706-4831-90e0-b877935926a8 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:30.733036 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a31b69c7-7706-4831-90e0-b877935926a8 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:30.733869 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a31b69c7-7706-4831-90e0-b877935926a8 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:30.734378 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a31b69c7-7706-4831-90e0-b877935926a8 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:30.806190 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-22028aca-566d-474a-a4f2-7fedb591a1c7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:30.813583 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-22028aca-566d-474a-a4f2-7fedb591a1c7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.144332 Jun 07 13:14:30.814183 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 69/122] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:30 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:30.841671 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ae73f857-5c42-4891-9d4d-eebf5ad644d6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:30.842283 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ae73f857-5c42-4891-9d4d-eebf5ad644d6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:30.848795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ae73f857-5c42-4891-9d4d-eebf5ad644d6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:30.849238 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ae73f857-5c42-4891-9d4d-eebf5ad644d6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:30.849992 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ae73f857-5c42-4891-9d4d-eebf5ad644d6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:30.850420 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ae73f857-5c42-4891-9d4d-eebf5ad644d6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:30.864813 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a31b69c7-7706-4831-90e0-b877935926a8 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:30.866675 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:30.872577 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a31b69c7-7706-4831-90e0-b877935926a8 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.150794 Jun 07 13:14:30.873160 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 54/123] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:30 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:30.991955 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ae73f857-5c42-4891-9d4d-eebf5ad644d6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:30.999541 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ae73f857-5c42-4891-9d4d-eebf5ad644d6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.161621 Jun 07 13:14:31.000151 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 70/124] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:30 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:31.559613 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-fc61f968-fe0a-44bf-98a4-9f51ec5b611d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:31.560395 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-fc61f968-fe0a-44bf-98a4-9f51ec5b611d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:31.568220 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fc61f968-fe0a-44bf-98a4-9f51ec5b611d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:31.568671 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fc61f968-fe0a-44bf-98a4-9f51ec5b611d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:31.569439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fc61f968-fe0a-44bf-98a4-9f51ec5b611d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:31.569873 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fc61f968-fe0a-44bf-98a4-9f51ec5b611d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:31.581340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-dca93308-2681-4adc-8171-d80d0e45135d tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:31.581969 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-dca93308-2681-4adc-8171-d80d0e45135d tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:31.583823 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=9 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:31.591239 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dca93308-2681-4adc-8171-d80d0e45135d tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:31.592482 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dca93308-2681-4adc-8171-d80d0e45135d tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:31.593745 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dca93308-2681-4adc-8171-d80d0e45135d tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:31.594645 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dca93308-2681-4adc-8171-d80d0e45135d tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:31.636646 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-fc61f968-fe0a-44bf-98a4-9f51ec5b611d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:31.644646 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-fc61f968-fe0a-44bf-98a4-9f51ec5b611d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:31.646138 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-fc61f968-fe0a-44bf-98a4-9f51ec5b611d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:31.647263 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-fc61f968-fe0a-44bf-98a4-9f51ec5b611d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1333 microversion: 2.20 time: 0.091560 Jun 07 13:14:31.647815 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 55/125] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:31 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:31.730827 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-dca93308-2681-4adc-8171-d80d0e45135d tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:31.739326 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-dca93308-2681-4adc-8171-d80d0e45135d tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.161798 Jun 07 13:14:31.739898 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 71/126] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:31 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:31.830318 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-42ac9bfe-8ed5-4c9b-abdd-c110139f15a6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:31.830975 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-42ac9bfe-8ed5-4c9b-abdd-c110139f15a6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:31.836992 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-42ac9bfe-8ed5-4c9b-abdd-c110139f15a6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:31.837443 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-42ac9bfe-8ed5-4c9b-abdd-c110139f15a6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:31.838231 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-42ac9bfe-8ed5-4c9b-abdd-c110139f15a6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:31.838697 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-42ac9bfe-8ed5-4c9b-abdd-c110139f15a6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:31.889315 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bb4be80b-0c62-4580-b4b8-8890765a7862 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:31.889934 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bb4be80b-0c62-4580-b4b8-8890765a7862 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:31.896484 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb4be80b-0c62-4580-b4b8-8890765a7862 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:31.896943 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb4be80b-0c62-4580-b4b8-8890765a7862 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:31.897716 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb4be80b-0c62-4580-b4b8-8890765a7862 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:31.898154 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb4be80b-0c62-4580-b4b8-8890765a7862 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:31.963822 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-42ac9bfe-8ed5-4c9b-abdd-c110139f15a6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:31.971715 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-42ac9bfe-8ed5-4c9b-abdd-c110139f15a6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.145329 Jun 07 13:14:31.972287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 56/127] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:31 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:32.017212 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-6d9ef978-829a-4d90-94d1-31d90e35ae43 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:32.017947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-6d9ef978-829a-4d90-94d1-31d90e35ae43 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:32.023877 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6d9ef978-829a-4d90-94d1-31d90e35ae43 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:32.024332 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6d9ef978-829a-4d90-94d1-31d90e35ae43 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:32.025133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6d9ef978-829a-4d90-94d1-31d90e35ae43 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:32.025574 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6d9ef978-829a-4d90-94d1-31d90e35ae43 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:32.027671 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bb4be80b-0c62-4580-b4b8-8890765a7862 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:32.035891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bb4be80b-0c62-4580-b4b8-8890765a7862 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.150374 Jun 07 13:14:32.036549 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 72/128] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:31 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:32.151819 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-6d9ef978-829a-4d90-94d1-31d90e35ae43 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:32.159815 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-6d9ef978-829a-4d90-94d1-31d90e35ae43 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.146924 Jun 07 13:14:32.160381 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 57/129] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:32 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:32.666531 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-812ecd79-e765-43b6-bc67-3508921b6936 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:32.667144 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-812ecd79-e765-43b6-bc67-3508921b6936 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:32.673199 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-812ecd79-e765-43b6-bc67-3508921b6936 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:32.673649 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-812ecd79-e765-43b6-bc67-3508921b6936 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:32.674414 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-812ecd79-e765-43b6-bc67-3508921b6936 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:32.674879 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-812ecd79-e765-43b6-bc67-3508921b6936 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:32.733107 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-812ecd79-e765-43b6-bc67-3508921b6936 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:32.741310 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-812ecd79-e765-43b6-bc67-3508921b6936 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:32.742850 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-812ecd79-e765-43b6-bc67-3508921b6936 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:32.743944 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-812ecd79-e765-43b6-bc67-3508921b6936 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1333 microversion: 2.20 time: 0.081260 Jun 07 13:14:32.744511 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 73/130] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:32 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1333 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:32.756275 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-39a08251-2ec8-4998-be5e-0411935849fb tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:32.756886 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-39a08251-2ec8-4998-be5e-0411935849fb tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:32.762910 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39a08251-2ec8-4998-be5e-0411935849fb tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:32.763358 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39a08251-2ec8-4998-be5e-0411935849fb tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:32.764118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39a08251-2ec8-4998-be5e-0411935849fb tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:32.764552 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39a08251-2ec8-4998-be5e-0411935849fb tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:32.833977 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=10 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:32.893073 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-39a08251-2ec8-4998-be5e-0411935849fb tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:32.900436 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-39a08251-2ec8-4998-be5e-0411935849fb tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.147966 Jun 07 13:14:32.901000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 58/131] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:32 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:32.988730 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-501c4b89-2dbf-42a7-bce4-301fb010b223 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:32.989352 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-501c4b89-2dbf-42a7-bce4-301fb010b223 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:32.991177 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:32.997156 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-501c4b89-2dbf-42a7-bce4-301fb010b223 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:32.997633 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-501c4b89-2dbf-42a7-bce4-301fb010b223 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:32.998382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-501c4b89-2dbf-42a7-bce4-301fb010b223 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:32.998851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-501c4b89-2dbf-42a7-bce4-301fb010b223 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:33.053207 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b5bf02ab-616d-449a-909e-e439469b63c3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:33.053816 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b5bf02ab-616d-449a-909e-e439469b63c3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:33.055649 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:33.061791 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b5bf02ab-616d-449a-909e-e439469b63c3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:33.062240 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b5bf02ab-616d-449a-909e-e439469b63c3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:33.063628 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b5bf02ab-616d-449a-909e-e439469b63c3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:33.064076 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b5bf02ab-616d-449a-909e-e439469b63c3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:33.126549 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-501c4b89-2dbf-42a7-bce4-301fb010b223 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:33.134016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-501c4b89-2dbf-42a7-bce4-301fb010b223 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.149526 Jun 07 13:14:33.134604 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 74/132] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:32 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:33.177424 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-368bfd3f-a377-48b4-acf3-22ee18b0f686 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:33.178041 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-368bfd3f-a377-48b4-acf3-22ee18b0f686 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:33.184043 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-368bfd3f-a377-48b4-acf3-22ee18b0f686 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:33.184496 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-368bfd3f-a377-48b4-acf3-22ee18b0f686 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:33.185259 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-368bfd3f-a377-48b4-acf3-22ee18b0f686 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:33.185696 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-368bfd3f-a377-48b4-acf3-22ee18b0f686 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:33.197032 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b5bf02ab-616d-449a-909e-e439469b63c3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:33.204328 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b5bf02ab-616d-449a-909e-e439469b63c3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.154948 Jun 07 13:14:33.204889 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 59/133] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:33 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:33.311873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-368bfd3f-a377-48b4-acf3-22ee18b0f686 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:33.319400 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-368bfd3f-a377-48b4-acf3-22ee18b0f686 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.145846 Jun 07 13:14:33.319969 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 75/134] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:33 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:33.761864 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-76dcce82-756e-403e-a816-d8a69f4ceab8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:33.762481 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-76dcce82-756e-403e-a816-d8a69f4ceab8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:33.768928 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-76dcce82-756e-403e-a816-d8a69f4ceab8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:33.769368 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-76dcce82-756e-403e-a816-d8a69f4ceab8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:33.770109 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-76dcce82-756e-403e-a816-d8a69f4ceab8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:33.770559 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-76dcce82-756e-403e-a816-d8a69f4ceab8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:33.831496 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-76dcce82-756e-403e-a816-d8a69f4ceab8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:33.848343 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-76dcce82-756e-403e-a816-d8a69f4ceab8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:33.849861 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-76dcce82-756e-403e-a816-d8a69f4ceab8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:33.850983 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-76dcce82-756e-403e-a816-d8a69f4ceab8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1333 microversion: 2.20 time: 0.092963 Jun 07 13:14:33.851537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 60/135] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:33 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:33.917286 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e6765591-30f0-4b4f-8e47-e38adca8555f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:33.917837 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e6765591-30f0-4b4f-8e47-e38adca8555f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:33.923848 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e6765591-30f0-4b4f-8e47-e38adca8555f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:33.924294 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e6765591-30f0-4b4f-8e47-e38adca8555f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:33.925055 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e6765591-30f0-4b4f-8e47-e38adca8555f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:33.925490 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e6765591-30f0-4b4f-8e47-e38adca8555f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:34.049693 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e6765591-30f0-4b4f-8e47-e38adca8555f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:34.057134 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e6765591-30f0-4b4f-8e47-e38adca8555f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.143685 Jun 07 13:14:34.057732 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 76/136] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:33 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:34.151120 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-6e19f117-3d3d-4b03-b0e5-99960b75adca tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:34.151734 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-6e19f117-3d3d-4b03-b0e5-99960b75adca tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:34.157676 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6e19f117-3d3d-4b03-b0e5-99960b75adca tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:34.158132 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6e19f117-3d3d-4b03-b0e5-99960b75adca tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:34.158917 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6e19f117-3d3d-4b03-b0e5-99960b75adca tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:34.159358 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6e19f117-3d3d-4b03-b0e5-99960b75adca tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:34.221184 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-508499ef-53de-4e23-ba57-f16ad4c43b34 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:34.221798 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-508499ef-53de-4e23-ba57-f16ad4c43b34 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:34.227863 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-508499ef-53de-4e23-ba57-f16ad4c43b34 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:34.228471 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-508499ef-53de-4e23-ba57-f16ad4c43b34 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:34.229284 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-508499ef-53de-4e23-ba57-f16ad4c43b34 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:34.229778 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-508499ef-53de-4e23-ba57-f16ad4c43b34 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:34.290081 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-6e19f117-3d3d-4b03-b0e5-99960b75adca tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:34.298132 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-6e19f117-3d3d-4b03-b0e5-99960b75adca tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.150263 Jun 07 13:14:34.298722 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 61/137] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:34 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:34.335835 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-6d061f1d-2624-485f-b6e1-cb608918e7bb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:34.336441 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-6d061f1d-2624-485f-b6e1-cb608918e7bb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:34.342776 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6d061f1d-2624-485f-b6e1-cb608918e7bb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:34.343236 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6d061f1d-2624-485f-b6e1-cb608918e7bb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:34.344002 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6d061f1d-2624-485f-b6e1-cb608918e7bb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:34.344472 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6d061f1d-2624-485f-b6e1-cb608918e7bb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:34.348489 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:34.362680 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-508499ef-53de-4e23-ba57-f16ad4c43b34 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:34.370351 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-508499ef-53de-4e23-ba57-f16ad4c43b34 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.153203 Jun 07 13:14:34.371229 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 77/138] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:34 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:34.476847 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-6d061f1d-2624-485f-b6e1-cb608918e7bb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:34.484279 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-6d061f1d-2624-485f-b6e1-cb608918e7bb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.152358 Jun 07 13:14:34.485335 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 62/139] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:34 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:34.868720 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-37779c34-b0c8-40ed-a6fb-98e577cc2cde tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:34.869368 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-37779c34-b0c8-40ed-a6fb-98e577cc2cde tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:34.875543 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-37779c34-b0c8-40ed-a6fb-98e577cc2cde tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:34.875996 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-37779c34-b0c8-40ed-a6fb-98e577cc2cde tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:34.876754 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-37779c34-b0c8-40ed-a6fb-98e577cc2cde tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:34.877187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-37779c34-b0c8-40ed-a6fb-98e577cc2cde tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:34.936269 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-37779c34-b0c8-40ed-a6fb-98e577cc2cde tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:34.944854 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-37779c34-b0c8-40ed-a6fb-98e577cc2cde tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:34.946371 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-37779c34-b0c8-40ed-a6fb-98e577cc2cde tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:34.947488 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-37779c34-b0c8-40ed-a6fb-98e577cc2cde tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1333 microversion: 2.20 time: 0.082662 Jun 07 13:14:34.948053 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 78/140] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:34 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1333 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:35.074115 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ce00fe56-9d76-4d5a-a1bd-95e106321f8a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:35.074780 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ce00fe56-9d76-4d5a-a1bd-95e106321f8a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:35.081320 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce00fe56-9d76-4d5a-a1bd-95e106321f8a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:35.081769 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce00fe56-9d76-4d5a-a1bd-95e106321f8a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:35.082575 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce00fe56-9d76-4d5a-a1bd-95e106321f8a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:35.083013 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce00fe56-9d76-4d5a-a1bd-95e106321f8a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:35.211015 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ce00fe56-9d76-4d5a-a1bd-95e106321f8a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:35.218284 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ce00fe56-9d76-4d5a-a1bd-95e106321f8a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.148019 Jun 07 13:14:35.218882 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 63/141] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:35 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:35.314885 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-494a809f-0b7b-4c52-93e1-c7b06984b646 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:35.315533 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-494a809f-0b7b-4c52-93e1-c7b06984b646 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:35.322935 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-494a809f-0b7b-4c52-93e1-c7b06984b646 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:35.323388 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-494a809f-0b7b-4c52-93e1-c7b06984b646 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:35.324153 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-494a809f-0b7b-4c52-93e1-c7b06984b646 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:35.324619 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-494a809f-0b7b-4c52-93e1-c7b06984b646 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:35.391729 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-682295e5-c6a8-45e5-a128-f8e024cef04c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:35.392275 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-682295e5-c6a8-45e5-a128-f8e024cef04c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:35.398296 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-682295e5-c6a8-45e5-a128-f8e024cef04c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:35.398782 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-682295e5-c6a8-45e5-a128-f8e024cef04c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:35.399552 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-682295e5-c6a8-45e5-a128-f8e024cef04c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:35.400012 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-682295e5-c6a8-45e5-a128-f8e024cef04c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:35.451626 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-494a809f-0b7b-4c52-93e1-c7b06984b646 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:35.459585 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-494a809f-0b7b-4c52-93e1-c7b06984b646 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.148628 Jun 07 13:14:35.460391 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 79/142] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:35 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:35.502384 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b930556e-f6c4-43a4-ba4b-1646f7aa89cc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:35.503345 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b930556e-f6c4-43a4-ba4b-1646f7aa89cc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:35.510037 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b930556e-f6c4-43a4-ba4b-1646f7aa89cc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:35.510505 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b930556e-f6c4-43a4-ba4b-1646f7aa89cc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:35.511275 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b930556e-f6c4-43a4-ba4b-1646f7aa89cc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:35.511709 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b930556e-f6c4-43a4-ba4b-1646f7aa89cc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:35.531380 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-682295e5-c6a8-45e5-a128-f8e024cef04c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:35.539038 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-682295e5-c6a8-45e5-a128-f8e024cef04c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.151806 Jun 07 13:14:35.539607 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 64/143] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:35 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:35.638098 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b930556e-f6c4-43a4-ba4b-1646f7aa89cc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:35.646211 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b930556e-f6c4-43a4-ba4b-1646f7aa89cc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.148278 Jun 07 13:14:35.646755 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 80/144] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:35 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:35.964511 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ee20ed6a-094d-41d7-9ba6-7f9f9b2fc399 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:35.965046 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ee20ed6a-094d-41d7-9ba6-7f9f9b2fc399 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:35.971033 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ee20ed6a-094d-41d7-9ba6-7f9f9b2fc399 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:35.971477 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ee20ed6a-094d-41d7-9ba6-7f9f9b2fc399 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:35.972230 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ee20ed6a-094d-41d7-9ba6-7f9f9b2fc399 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:35.972661 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ee20ed6a-094d-41d7-9ba6-7f9f9b2fc399 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.031836 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ee20ed6a-094d-41d7-9ba6-7f9f9b2fc399 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:36.039921 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ee20ed6a-094d-41d7-9ba6-7f9f9b2fc399 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:36.041456 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ee20ed6a-094d-41d7-9ba6-7f9f9b2fc399 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:36.042633 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ee20ed6a-094d-41d7-9ba6-7f9f9b2fc399 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1333 microversion: 2.20 time: 0.082042 Jun 07 13:14:36.043184 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 65/145] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:35 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1333 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:36.236089 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fdaf795e-49bb-4760-be06-cddded5f4bf1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:36.236742 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fdaf795e-49bb-4760-be06-cddded5f4bf1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:36.242884 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fdaf795e-49bb-4760-be06-cddded5f4bf1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:36.243345 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fdaf795e-49bb-4760-be06-cddded5f4bf1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.244627 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fdaf795e-49bb-4760-be06-cddded5f4bf1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:36.244627 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fdaf795e-49bb-4760-be06-cddded5f4bf1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.479385 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-bbe9bbf3-2941-4e48-afb2-3ceee72935b1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:36.480954 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-bbe9bbf3-2941-4e48-afb2-3ceee72935b1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:36.489327 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bbe9bbf3-2941-4e48-afb2-3ceee72935b1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:36.490150 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bbe9bbf3-2941-4e48-afb2-3ceee72935b1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.491127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bbe9bbf3-2941-4e48-afb2-3ceee72935b1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:36.491723 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bbe9bbf3-2941-4e48-afb2-3ceee72935b1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.735387 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fdaf795e-49bb-4760-be06-cddded5f4bf1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:36.745715 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fdaf795e-49bb-4760-be06-cddded5f4bf1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.513983 Jun 07 13:14:36.746738 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 81/146] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:36 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:36.760206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-88711729-9c13-4cd8-873c-612d4c81e862 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:36.760827 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-88711729-9c13-4cd8-873c-612d4c81e862 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:36.770504 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-88711729-9c13-4cd8-873c-612d4c81e862 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:36.770941 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-88711729-9c13-4cd8-873c-612d4c81e862 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.771894 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-88711729-9c13-4cd8-873c-612d4c81e862 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:36.772333 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-88711729-9c13-4cd8-873c-612d4c81e862 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.921056 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-88711729-9c13-4cd8-873c-612d4c81e862 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:36.931545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-88711729-9c13-4cd8-873c-612d4c81e862 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.175343 Jun 07 13:14:36.941344 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 82/147] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:36 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:36.941344 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ac8d916d-ade8-4f4c-b7bd-38d54c5f0180 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:36.941344 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ac8d916d-ade8-4f4c-b7bd-38d54c5f0180 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:36.944093 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ac8d916d-ade8-4f4c-b7bd-38d54c5f0180 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:36.944562 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ac8d916d-ade8-4f4c-b7bd-38d54c5f0180 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.945333 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ac8d916d-ade8-4f4c-b7bd-38d54c5f0180 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:36.945774 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ac8d916d-ade8-4f4c-b7bd-38d54c5f0180 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:37.018679 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-bbe9bbf3-2941-4e48-afb2-3ceee72935b1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:37.028556 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-bbe9bbf3-2941-4e48-afb2-3ceee72935b1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.555437 Jun 07 13:14:37.029146 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 66/148] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:36 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:37.061123 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8a4e29cd-f6c6-47c4-a802-1cbe53c96e1e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:37.061807 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8a4e29cd-f6c6-47c4-a802-1cbe53c96e1e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:37.069444 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8a4e29cd-f6c6-47c4-a802-1cbe53c96e1e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:37.069894 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8a4e29cd-f6c6-47c4-a802-1cbe53c96e1e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:37.070751 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8a4e29cd-f6c6-47c4-a802-1cbe53c96e1e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:37.071187 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8a4e29cd-f6c6-47c4-a802-1cbe53c96e1e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:37.111575 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ac8d916d-ade8-4f4c-b7bd-38d54c5f0180 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:37.119063 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ac8d916d-ade8-4f4c-b7bd-38d54c5f0180 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.185981 Jun 07 13:14:37.119863 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 83/149] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:36 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:37.134312 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8a4e29cd-f6c6-47c4-a802-1cbe53c96e1e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:37.142882 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8a4e29cd-f6c6-47c4-a802-1cbe53c96e1e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:37.144388 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8a4e29cd-f6c6-47c4-a802-1cbe53c96e1e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:37.145472 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8a4e29cd-f6c6-47c4-a802-1cbe53c96e1e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1333 microversion: 2.20 time: 0.088379 Jun 07 13:14:37.146184 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 67/150] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:37 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:14:37.762666 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d98e9349-1071-46be-8636-c7a58ef58506 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:37.763278 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d98e9349-1071-46be-8636-c7a58ef58506 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:37.769382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d98e9349-1071-46be-8636-c7a58ef58506 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:37.769830 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d98e9349-1071-46be-8636-c7a58ef58506 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:37.770621 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d98e9349-1071-46be-8636-c7a58ef58506 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:37.771066 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d98e9349-1071-46be-8636-c7a58ef58506 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:37.898876 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d98e9349-1071-46be-8636-c7a58ef58506 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:37.906219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d98e9349-1071-46be-8636-c7a58ef58506 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.147469 Jun 07 13:14:37.907387 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 84/151] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:37 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:37.948654 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c1ab7887-ad4f-4516-82ea-97aa44147459 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:37.949291 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c1ab7887-ad4f-4516-82ea-97aa44147459 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:37.955326 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c1ab7887-ad4f-4516-82ea-97aa44147459 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:37.955785 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c1ab7887-ad4f-4516-82ea-97aa44147459 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:37.956547 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c1ab7887-ad4f-4516-82ea-97aa44147459 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:37.956983 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c1ab7887-ad4f-4516-82ea-97aa44147459 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:38.045110 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-dbfc23a1-3ade-41a2-a7a9-e29e1fec7830 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:38.045727 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-dbfc23a1-3ade-41a2-a7a9-e29e1fec7830 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:38.052236 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dbfc23a1-3ade-41a2-a7a9-e29e1fec7830 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:38.052692 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dbfc23a1-3ade-41a2-a7a9-e29e1fec7830 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:38.053475 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dbfc23a1-3ade-41a2-a7a9-e29e1fec7830 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:38.053902 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dbfc23a1-3ade-41a2-a7a9-e29e1fec7830 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:38.085484 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c1ab7887-ad4f-4516-82ea-97aa44147459 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:38.092965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c1ab7887-ad4f-4516-82ea-97aa44147459 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.148063 Jun 07 13:14:38.093527 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 68/152] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:37 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:38.137105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-cab5783b-de64-4c44-8502-da06b42eafee tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:38.137715 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-cab5783b-de64-4c44-8502-da06b42eafee tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:38.144313 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cab5783b-de64-4c44-8502-da06b42eafee tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:38.144762 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cab5783b-de64-4c44-8502-da06b42eafee tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:38.145525 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cab5783b-de64-4c44-8502-da06b42eafee tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:38.145962 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cab5783b-de64-4c44-8502-da06b42eafee tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:38.184148 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-dbfc23a1-3ade-41a2-a7a9-e29e1fec7830 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:38.191684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-dbfc23a1-3ade-41a2-a7a9-e29e1fec7830 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.150462 Jun 07 13:14:38.198491 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 85/153] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:38 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:38.198491 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-22f915ca-087d-4256-8e64-afde5997875c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:38.198491 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-22f915ca-087d-4256-8e64-afde5997875c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:38.202976 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-22f915ca-087d-4256-8e64-afde5997875c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:38.203934 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-22f915ca-087d-4256-8e64-afde5997875c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:38.204706 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-22f915ca-087d-4256-8e64-afde5997875c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:38.205173 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-22f915ca-087d-4256-8e64-afde5997875c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:38.272902 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-22f915ca-087d-4256-8e64-afde5997875c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:38.277923 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cab5783b-de64-4c44-8502-da06b42eafee tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:38.281250 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-22f915ca-087d-4256-8e64-afde5997875c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:38.283173 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-22f915ca-087d-4256-8e64-afde5997875c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:38.284262 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-22f915ca-087d-4256-8e64-afde5997875c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1333 microversion: 2.20 time: 0.091097 Jun 07 13:14:38.284817 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 86/154] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:38 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:38.286128 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-cab5783b-de64-4c44-8502-da06b42eafee tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.152916 Jun 07 13:14:38.286715 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 69/155] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:38 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:38.923491 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e2b59786-dd49-4b9d-b83a-8af0349435e7 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:38.924122 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e2b59786-dd49-4b9d-b83a-8af0349435e7 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:38.930041 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e2b59786-dd49-4b9d-b83a-8af0349435e7 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:38.930513 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e2b59786-dd49-4b9d-b83a-8af0349435e7 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:38.931263 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e2b59786-dd49-4b9d-b83a-8af0349435e7 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:38.931690 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e2b59786-dd49-4b9d-b83a-8af0349435e7 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:38.935481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:39.055388 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e2b59786-dd49-4b9d-b83a-8af0349435e7 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:39.063527 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e2b59786-dd49-4b9d-b83a-8af0349435e7 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.143608 Jun 07 13:14:39.064105 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 87/156] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:38 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:39.109272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3c597e13-d973-42bf-83a1-49eedc6c68d6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:39.110353 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3c597e13-d973-42bf-83a1-49eedc6c68d6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:39.116225 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3c597e13-d973-42bf-83a1-49eedc6c68d6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:39.116666 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3c597e13-d973-42bf-83a1-49eedc6c68d6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:39.117416 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3c597e13-d973-42bf-83a1-49eedc6c68d6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:39.117844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3c597e13-d973-42bf-83a1-49eedc6c68d6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:39.208278 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-97745477-c9e1-45a7-a594-82886f820966 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:39.208882 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-97745477-c9e1-45a7-a594-82886f820966 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:39.215024 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-97745477-c9e1-45a7-a594-82886f820966 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:39.215476 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-97745477-c9e1-45a7-a594-82886f820966 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:39.216391 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-97745477-c9e1-45a7-a594-82886f820966 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:39.216840 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-97745477-c9e1-45a7-a594-82886f820966 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:39.245114 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3c597e13-d973-42bf-83a1-49eedc6c68d6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:39.252714 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3c597e13-d973-42bf-83a1-49eedc6c68d6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.147109 Jun 07 13:14:39.253285 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 70/157] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:39 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:39.302604 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-2074d5ad-9049-46ce-a6e2-ad3fd62f0774 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:39.303218 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-2074d5ad-9049-46ce-a6e2-ad3fd62f0774 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:39.309338 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2074d5ad-9049-46ce-a6e2-ad3fd62f0774 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:39.309785 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2074d5ad-9049-46ce-a6e2-ad3fd62f0774 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:39.310577 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2074d5ad-9049-46ce-a6e2-ad3fd62f0774 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:39.311020 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2074d5ad-9049-46ce-a6e2-ad3fd62f0774 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:39.342549 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-97745477-c9e1-45a7-a594-82886f820966 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:39.350946 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-97745477-c9e1-45a7-a594-82886f820966 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.146375 Jun 07 13:14:39.351521 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 88/158] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:39 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:39.355996 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-09bf3b92-76c7-4dba-acb3-6f1b9eb188e4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:39.356598 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-09bf3b92-76c7-4dba-acb3-6f1b9eb188e4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:39.363286 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-09bf3b92-76c7-4dba-acb3-6f1b9eb188e4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:39.363733 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-09bf3b92-76c7-4dba-acb3-6f1b9eb188e4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:39.364497 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-09bf3b92-76c7-4dba-acb3-6f1b9eb188e4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:39.364933 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-09bf3b92-76c7-4dba-acb3-6f1b9eb188e4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:39.427552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-09bf3b92-76c7-4dba-acb3-6f1b9eb188e4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:39.435470 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-09bf3b92-76c7-4dba-acb3-6f1b9eb188e4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:39.436984 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-09bf3b92-76c7-4dba-acb3-6f1b9eb188e4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:39.438088 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-09bf3b92-76c7-4dba-acb3-6f1b9eb188e4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1333 microversion: 2.20 time: 0.085645 Jun 07 13:14:39.438678 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 89/159] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:39 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:39.440001 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-2074d5ad-9049-46ce-a6e2-ad3fd62f0774 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:39.447562 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-2074d5ad-9049-46ce-a6e2-ad3fd62f0774 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.148701 Jun 07 13:14:39.448114 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 71/160] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:39 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:40.080925 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-979d6074-4783-4098-8720-0d7af3d87613 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:40.081538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-979d6074-4783-4098-8720-0d7af3d87613 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:40.087593 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-979d6074-4783-4098-8720-0d7af3d87613 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:40.087988 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-979d6074-4783-4098-8720-0d7af3d87613 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:40.088750 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-979d6074-4783-4098-8720-0d7af3d87613 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:40.089186 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-979d6074-4783-4098-8720-0d7af3d87613 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:40.276803 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8156aeff-871d-404c-b25a-4a2b37fba0c2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:40.277582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8156aeff-871d-404c-b25a-4a2b37fba0c2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:40.284227 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8156aeff-871d-404c-b25a-4a2b37fba0c2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:40.284833 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8156aeff-871d-404c-b25a-4a2b37fba0c2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:40.285721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8156aeff-871d-404c-b25a-4a2b37fba0c2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:40.286286 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8156aeff-871d-404c-b25a-4a2b37fba0c2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:40.494602 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-979d6074-4783-4098-8720-0d7af3d87613 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:40.513093 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-979d6074-4783-4098-8720-0d7af3d87613 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.436389 Jun 07 13:14:40.523852 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 90/161] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:40 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:40.529704 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-23fa989e-e102-4fec-939d-ffdd805aa5d0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:40.530896 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-23fa989e-e102-4fec-939d-ffdd805aa5d0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:40.537267 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-23fa989e-e102-4fec-939d-ffdd805aa5d0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:40.537837 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-23fa989e-e102-4fec-939d-ffdd805aa5d0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:40.538736 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-23fa989e-e102-4fec-939d-ffdd805aa5d0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:40.539400 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-23fa989e-e102-4fec-939d-ffdd805aa5d0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:40.578572 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8156aeff-871d-404c-b25a-4a2b37fba0c2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:40.586138 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8156aeff-871d-404c-b25a-4a2b37fba0c2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.320558 Jun 07 13:14:40.586828 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 72/162] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:40 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:40.591535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1af7ae9c-e640-4ea5-9c94-84e01c980454 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:40.592139 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1af7ae9c-e640-4ea5-9c94-84e01c980454 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:40.598590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1af7ae9c-e640-4ea5-9c94-84e01c980454 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:40.599122 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1af7ae9c-e640-4ea5-9c94-84e01c980454 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:40.600103 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1af7ae9c-e640-4ea5-9c94-84e01c980454 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:40.600572 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1af7ae9c-e640-4ea5-9c94-84e01c980454 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:40.667861 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1af7ae9c-e640-4ea5-9c94-84e01c980454 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:40.676367 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1af7ae9c-e640-4ea5-9c94-84e01c980454 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:40.677860 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1af7ae9c-e640-4ea5-9c94-84e01c980454 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:40.678985 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1af7ae9c-e640-4ea5-9c94-84e01c980454 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1339 microversion: 2.20 time: 0.091057 Jun 07 13:14:40.679538 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 73/163] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:40 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1339 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:40.684463 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e18807b5-296e-4195-88d0-cc5ae42051c1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:40.685081 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-e18807b5-296e-4195-88d0-cc5ae42051c1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:40.691282 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e18807b5-296e-4195-88d0-cc5ae42051c1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:40.691725 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e18807b5-296e-4195-88d0-cc5ae42051c1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:40.692482 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e18807b5-296e-4195-88d0-cc5ae42051c1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:40.692909 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e18807b5-296e-4195-88d0-cc5ae42051c1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:40.738098 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-23fa989e-e102-4fec-939d-ffdd805aa5d0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:40.745505 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-23fa989e-e102-4fec-939d-ffdd805aa5d0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.220366 Jun 07 13:14:40.746070 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 91/164] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:40 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:40.893564 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e18807b5-296e-4195-88d0-cc5ae42051c1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:40.901864 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e18807b5-296e-4195-88d0-cc5ae42051c1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.221201 Jun 07 13:14:40.902582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 74/165] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:40 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:41.323529 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-9fbc7f6b-cf7c-4597-8cb0-5f1017b8379a req-ead629c1-30d0-4994-badc-f761a90744fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0", "name": "network-vif-plugged", "status": "completed", "tag": "fa01f4c1-c3a7-4d48-95e4-fa07833fc0cc"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:41.331913 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-9fbc7f6b-cf7c-4597-8cb0-5f1017b8379a req-ead629c1-30d0-4994-badc-f761a90744fe service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:41.332346 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-9fbc7f6b-cf7c-4597-8cb0-5f1017b8379a req-ead629c1-30d0-4994-badc-f761a90744fe service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:41.345942 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-9fbc7f6b-cf7c-4597-8cb0-5f1017b8379a req-ead629c1-30d0-4994-badc-f761a90744fe service nova] Creating event network-vif-plugged:fa01f4c1-c3a7-4d48-95e4-fa07833fc0cc for instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 on hv-cinder-84496 Jun 07 13:14:41.352243 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-9fbc7f6b-cf7c-4597-8cb0-5f1017b8379a req-ead629c1-30d0-4994-badc-f761a90744fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032662 Jun 07 13:14:41.353664 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 92/166] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:14:41.530293 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9b4d5975-bbf5-4240-9dc0-efce3d5b6420 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:41.531104 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9b4d5975-bbf5-4240-9dc0-efce3d5b6420 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:41.537894 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9b4d5975-bbf5-4240-9dc0-efce3d5b6420 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:41.538352 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9b4d5975-bbf5-4240-9dc0-efce3d5b6420 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:41.542807 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9b4d5975-bbf5-4240-9dc0-efce3d5b6420 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:41.542807 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9b4d5975-bbf5-4240-9dc0-efce3d5b6420 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:41.604025 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-80b55161-a1ff-47c8-b938-da9a4006a455 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:41.604795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-80b55161-a1ff-47c8-b938-da9a4006a455 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:41.612036 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-80b55161-a1ff-47c8-b938-da9a4006a455 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:41.612702 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-80b55161-a1ff-47c8-b938-da9a4006a455 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:41.613481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-80b55161-a1ff-47c8-b938-da9a4006a455 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:41.614184 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-80b55161-a1ff-47c8-b938-da9a4006a455 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:41.682421 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9b4d5975-bbf5-4240-9dc0-efce3d5b6420 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:41.690822 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9b4d5975-bbf5-4240-9dc0-efce3d5b6420 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.164421 Jun 07 13:14:41.691664 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 75/167] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:41 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:41.697583 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-55f36fb1-5068-478d-83a7-65a81d2bbc02 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:41.698307 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-55f36fb1-5068-478d-83a7-65a81d2bbc02 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:41.704544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-55f36fb1-5068-478d-83a7-65a81d2bbc02 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:41.704986 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-55f36fb1-5068-478d-83a7-65a81d2bbc02 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:41.705888 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-55f36fb1-5068-478d-83a7-65a81d2bbc02 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:41.706322 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-55f36fb1-5068-478d-83a7-65a81d2bbc02 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:41.774427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-55f36fb1-5068-478d-83a7-65a81d2bbc02 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:41.784453 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-55f36fb1-5068-478d-83a7-65a81d2bbc02 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:41.785978 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-55f36fb1-5068-478d-83a7-65a81d2bbc02 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:41.787601 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-55f36fb1-5068-478d-83a7-65a81d2bbc02 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1339 microversion: 2.20 time: 0.094066 Jun 07 13:14:41.788430 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 76/168] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:41 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1339 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:41.803302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-69d7b552-72ef-4d5b-be62-ad402c7ae553 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:41.803921 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-69d7b552-72ef-4d5b-be62-ad402c7ae553 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:41.805937 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-80b55161-a1ff-47c8-b938-da9a4006a455 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:41.810037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-69d7b552-72ef-4d5b-be62-ad402c7ae553 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:41.810518 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-69d7b552-72ef-4d5b-be62-ad402c7ae553 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:41.811284 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-69d7b552-72ef-4d5b-be62-ad402c7ae553 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:41.811709 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-69d7b552-72ef-4d5b-be62-ad402c7ae553 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:41.814122 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-80b55161-a1ff-47c8-b938-da9a4006a455 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.214368 Jun 07 13:14:41.814880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 93/169] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:41 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:41.919251 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cbe0ed85-b539-468b-a2ae-91c96b6e15a8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:41.919913 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cbe0ed85-b539-468b-a2ae-91c96b6e15a8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:41.926100 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cbe0ed85-b539-468b-a2ae-91c96b6e15a8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:41.926843 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cbe0ed85-b539-468b-a2ae-91c96b6e15a8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:41.928081 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cbe0ed85-b539-468b-a2ae-91c96b6e15a8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:41.928530 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cbe0ed85-b539-468b-a2ae-91c96b6e15a8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:41.980545 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-69d7b552-72ef-4d5b-be62-ad402c7ae553 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:41.997575 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-69d7b552-72ef-4d5b-be62-ad402c7ae553 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.197146 Jun 07 13:14:41.998748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 77/170] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:41 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:42.068553 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cbe0ed85-b539-468b-a2ae-91c96b6e15a8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:42.076219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cbe0ed85-b539-468b-a2ae-91c96b6e15a8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.160836 Jun 07 13:14:42.076795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 94/171] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:41 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:42.707487 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-85544c93-86eb-4b70-80de-fdd6069f2984 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:42.708026 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-85544c93-86eb-4b70-80de-fdd6069f2984 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:42.713987 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-85544c93-86eb-4b70-80de-fdd6069f2984 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:42.714428 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-85544c93-86eb-4b70-80de-fdd6069f2984 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:42.715200 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-85544c93-86eb-4b70-80de-fdd6069f2984 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:42.715624 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-85544c93-86eb-4b70-80de-fdd6069f2984 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:42.807146 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c3454c68-3c5c-49ce-89b2-97a90e2bf2db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:42.808050 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c3454c68-3c5c-49ce-89b2-97a90e2bf2db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:42.814509 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3454c68-3c5c-49ce-89b2-97a90e2bf2db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:42.814952 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3454c68-3c5c-49ce-89b2-97a90e2bf2db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:42.815958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3454c68-3c5c-49ce-89b2-97a90e2bf2db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:42.816597 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3454c68-3c5c-49ce-89b2-97a90e2bf2db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:42.853788 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-85544c93-86eb-4b70-80de-fdd6069f2984 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:42.856084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:42.863369 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-85544c93-86eb-4b70-80de-fdd6069f2984 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.160277 Jun 07 13:14:42.863950 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 78/172] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:42 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:42.868496 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5b095fe7-8628-49aa-a3db-f9d965e4debc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:42.869099 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5b095fe7-8628-49aa-a3db-f9d965e4debc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:42.875608 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5b095fe7-8628-49aa-a3db-f9d965e4debc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:42.876059 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5b095fe7-8628-49aa-a3db-f9d965e4debc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:42.876833 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5b095fe7-8628-49aa-a3db-f9d965e4debc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:42.877265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5b095fe7-8628-49aa-a3db-f9d965e4debc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:42.910336 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c3454c68-3c5c-49ce-89b2-97a90e2bf2db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:42.918709 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c3454c68-3c5c-49ce-89b2-97a90e2bf2db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:42.920235 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c3454c68-3c5c-49ce-89b2-97a90e2bf2db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:42.921341 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c3454c68-3c5c-49ce-89b2-97a90e2bf2db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1339 microversion: 2.20 time: 0.119229 Jun 07 13:14:42.921902 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 95/173] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:42 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1339 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:14:43.014290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5b095fe7-8628-49aa-a3db-f9d965e4debc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:43.016594 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cb7520dd-ac7b-4875-90a7-21ef3dab7c0e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:43.017211 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cb7520dd-ac7b-4875-90a7-21ef3dab7c0e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:43.022299 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5b095fe7-8628-49aa-a3db-f9d965e4debc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.157374 Jun 07 13:14:43.023263 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cb7520dd-ac7b-4875-90a7-21ef3dab7c0e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:43.023713 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cb7520dd-ac7b-4875-90a7-21ef3dab7c0e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:43.024559 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cb7520dd-ac7b-4875-90a7-21ef3dab7c0e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:43.024994 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cb7520dd-ac7b-4875-90a7-21ef3dab7c0e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:43.031897 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 79/174] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:42 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:43.093446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1f6c0633-c80c-450f-ba15-a94d703eaf4d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:43.094180 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1f6c0633-c80c-450f-ba15-a94d703eaf4d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:43.100281 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1f6c0633-c80c-450f-ba15-a94d703eaf4d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:43.101007 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1f6c0633-c80c-450f-ba15-a94d703eaf4d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:43.101997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1f6c0633-c80c-450f-ba15-a94d703eaf4d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:43.102707 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1f6c0633-c80c-450f-ba15-a94d703eaf4d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:43.164609 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cb7520dd-ac7b-4875-90a7-21ef3dab7c0e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:43.173670 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cb7520dd-ac7b-4875-90a7-21ef3dab7c0e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.161745 Jun 07 13:14:43.174282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 96/175] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:43 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:43.262940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1f6c0633-c80c-450f-ba15-a94d703eaf4d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:43.273420 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1f6c0633-c80c-450f-ba15-a94d703eaf4d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.184153 Jun 07 13:14:43.274888 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 80/176] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:43 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:43.884668 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-341b09e8-49f8-4015-a8d9-f60d7e5c3332 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:43.885289 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-341b09e8-49f8-4015-a8d9-f60d7e5c3332 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:43.891345 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-341b09e8-49f8-4015-a8d9-f60d7e5c3332 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:43.891797 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-341b09e8-49f8-4015-a8d9-f60d7e5c3332 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:43.892602 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-341b09e8-49f8-4015-a8d9-f60d7e5c3332 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:43.893037 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-341b09e8-49f8-4015-a8d9-f60d7e5c3332 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:43.940809 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c40f36d3-7d05-4486-a623-c6c222b19e0e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:43.941454 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c40f36d3-7d05-4486-a623-c6c222b19e0e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:43.949677 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c40f36d3-7d05-4486-a623-c6c222b19e0e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:43.950159 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c40f36d3-7d05-4486-a623-c6c222b19e0e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:43.950996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c40f36d3-7d05-4486-a623-c6c222b19e0e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:43.951424 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c40f36d3-7d05-4486-a623-c6c222b19e0e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:44.021440 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c40f36d3-7d05-4486-a623-c6c222b19e0e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:44.023460 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-341b09e8-49f8-4015-a8d9-f60d7e5c3332 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:44.030833 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c40f36d3-7d05-4486-a623-c6c222b19e0e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:44.031441 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-341b09e8-49f8-4015-a8d9-f60d7e5c3332 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.154969 Jun 07 13:14:44.032626 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 97/177] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:43 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:44.033001 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c40f36d3-7d05-4486-a623-c6c222b19e0e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:44.034506 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c40f36d3-7d05-4486-a623-c6c222b19e0e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1339 microversion: 2.20 time: 0.097565 Jun 07 13:14:44.034668 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 81/178] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:43 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:14:44.040029 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a0761b25-56f6-4580-b496-fffce4fbeadd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:44.040640 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a0761b25-56f6-4580-b496-fffce4fbeadd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:44.047471 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a0761b25-56f6-4580-b496-fffce4fbeadd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:44.047921 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a0761b25-56f6-4580-b496-fffce4fbeadd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:44.048696 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a0761b25-56f6-4580-b496-fffce4fbeadd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:44.049129 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a0761b25-56f6-4580-b496-fffce4fbeadd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:44.187074 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a0761b25-56f6-4580-b496-fffce4fbeadd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:44.193022 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-65e4e6a5-038b-4d8a-bfd0-6ba9aac57e2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:44.193930 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-65e4e6a5-038b-4d8a-bfd0-6ba9aac57e2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:44.196604 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a0761b25-56f6-4580-b496-fffce4fbeadd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.160568 Jun 07 13:14:44.197164 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 98/179] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:44 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:44.205036 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-65e4e6a5-038b-4d8a-bfd0-6ba9aac57e2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:44.205674 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-65e4e6a5-038b-4d8a-bfd0-6ba9aac57e2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:44.206600 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-65e4e6a5-038b-4d8a-bfd0-6ba9aac57e2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:44.207044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-65e4e6a5-038b-4d8a-bfd0-6ba9aac57e2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:44.291587 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-53985b25-5fd4-487f-a5ad-b49d11c67e53 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:44.292344 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-53985b25-5fd4-487f-a5ad-b49d11c67e53 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:44.300231 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53985b25-5fd4-487f-a5ad-b49d11c67e53 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:44.300761 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53985b25-5fd4-487f-a5ad-b49d11c67e53 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:44.301847 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53985b25-5fd4-487f-a5ad-b49d11c67e53 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:44.302345 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53985b25-5fd4-487f-a5ad-b49d11c67e53 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:44.355405 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-65e4e6a5-038b-4d8a-bfd0-6ba9aac57e2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:44.364260 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-65e4e6a5-038b-4d8a-bfd0-6ba9aac57e2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.176608 Jun 07 13:14:44.365011 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 82/180] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:44 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:44.435528 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-53985b25-5fd4-487f-a5ad-b49d11c67e53 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:44.443464 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-53985b25-5fd4-487f-a5ad-b49d11c67e53 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.156718 Jun 07 13:14:44.444035 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 99/181] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:44 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:45.054379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-194a82a7-eaa4-42cc-b66e-32906b507918 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:45.059929 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8f85e642-0a17-4e62-83df-6766b34d8d63 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:45.060567 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8f85e642-0a17-4e62-83df-6766b34d8d63 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:45.060756 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-194a82a7-eaa4-42cc-b66e-32906b507918 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:45.067181 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8f85e642-0a17-4e62-83df-6766b34d8d63 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:45.067578 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-194a82a7-eaa4-42cc-b66e-32906b507918 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:45.067702 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8f85e642-0a17-4e62-83df-6766b34d8d63 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:45.068033 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-194a82a7-eaa4-42cc-b66e-32906b507918 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:45.068383 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8f85e642-0a17-4e62-83df-6766b34d8d63 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:45.068800 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-194a82a7-eaa4-42cc-b66e-32906b507918 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:45.068927 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8f85e642-0a17-4e62-83df-6766b34d8d63 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:45.069240 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-194a82a7-eaa4-42cc-b66e-32906b507918 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:45.130477 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-194a82a7-eaa4-42cc-b66e-32906b507918 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:45.138572 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-194a82a7-eaa4-42cc-b66e-32906b507918 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:45.140320 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-194a82a7-eaa4-42cc-b66e-32906b507918 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:45.141469 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-194a82a7-eaa4-42cc-b66e-32906b507918 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1339 microversion: 2.20 time: 0.091120 Jun 07 13:14:45.142015 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 83/182] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:45 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1339 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:45.210080 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8f85e642-0a17-4e62-83df-6766b34d8d63 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:45.215482 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-882c812d-c06a-4127-8ab3-0de6c6a2c1e7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:45.216266 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-882c812d-c06a-4127-8ab3-0de6c6a2c1e7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:45.216869 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8f85e642-0a17-4e62-83df-6766b34d8d63 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.160669 Jun 07 13:14:45.217477 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 100/183] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:45 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:45.223541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-882c812d-c06a-4127-8ab3-0de6c6a2c1e7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:45.224099 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-882c812d-c06a-4127-8ab3-0de6c6a2c1e7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:45.225001 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-882c812d-c06a-4127-8ab3-0de6c6a2c1e7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:45.225537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-882c812d-c06a-4127-8ab3-0de6c6a2c1e7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:45.354648 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-882c812d-c06a-4127-8ab3-0de6c6a2c1e7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:45.362611 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-882c812d-c06a-4127-8ab3-0de6c6a2c1e7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.151423 Jun 07 13:14:45.363180 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 84/184] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:45 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:45.381540 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9e2f033e-fc4e-4206-9221-964c7f0049e3 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:45.382262 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9e2f033e-fc4e-4206-9221-964c7f0049e3 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:45.388360 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9e2f033e-fc4e-4206-9221-964c7f0049e3 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:45.388874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9e2f033e-fc4e-4206-9221-964c7f0049e3 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:45.389693 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9e2f033e-fc4e-4206-9221-964c7f0049e3 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:45.390211 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9e2f033e-fc4e-4206-9221-964c7f0049e3 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:45.459921 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3d60dfd7-5468-410f-95a9-68d53ca87e7a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:45.460534 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3d60dfd7-5468-410f-95a9-68d53ca87e7a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:45.466855 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3d60dfd7-5468-410f-95a9-68d53ca87e7a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:45.467317 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3d60dfd7-5468-410f-95a9-68d53ca87e7a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:45.468082 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3d60dfd7-5468-410f-95a9-68d53ca87e7a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:45.468520 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3d60dfd7-5468-410f-95a9-68d53ca87e7a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:45.604729 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3d60dfd7-5468-410f-95a9-68d53ca87e7a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:45.613090 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3d60dfd7-5468-410f-95a9-68d53ca87e7a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.156970 Jun 07 13:14:45.613649 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 85/185] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:45 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:45.736000 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9e2f033e-fc4e-4206-9221-964c7f0049e3 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:45.743724 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9e2f033e-fc4e-4206-9221-964c7f0049e3 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.366420 Jun 07 13:14:45.744307 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 101/186] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:45 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:46.160524 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ab389b33-e48d-4749-8161-c278cc28a7f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:46.161140 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ab389b33-e48d-4749-8161-c278cc28a7f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:46.167716 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ab389b33-e48d-4749-8161-c278cc28a7f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:46.168215 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ab389b33-e48d-4749-8161-c278cc28a7f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:46.168977 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ab389b33-e48d-4749-8161-c278cc28a7f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:46.169404 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ab389b33-e48d-4749-8161-c278cc28a7f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:46.234529 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-49a74490-53bd-48e1-8cae-8f5ebb2a116e tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:46.235169 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-49a74490-53bd-48e1-8cae-8f5ebb2a116e tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:46.243254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-49a74490-53bd-48e1-8cae-8f5ebb2a116e tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:46.244000 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-49a74490-53bd-48e1-8cae-8f5ebb2a116e tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:46.246641 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-49a74490-53bd-48e1-8cae-8f5ebb2a116e tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:46.247096 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-49a74490-53bd-48e1-8cae-8f5ebb2a116e tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:46.254290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ab389b33-e48d-4749-8161-c278cc28a7f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:46.267912 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ab389b33-e48d-4749-8161-c278cc28a7f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:46.270880 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ab389b33-e48d-4749-8161-c278cc28a7f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:46.272335 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ab389b33-e48d-4749-8161-c278cc28a7f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1339 microversion: 2.20 time: 0.115698 Jun 07 13:14:46.274052 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 86/187] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:46 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1339 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:46.384031 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-89f58b68-62fa-4728-8eba-3b4011327abd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:46.385170 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-89f58b68-62fa-4728-8eba-3b4011327abd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:46.391980 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-89f58b68-62fa-4728-8eba-3b4011327abd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:46.392627 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-89f58b68-62fa-4728-8eba-3b4011327abd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:46.393681 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-89f58b68-62fa-4728-8eba-3b4011327abd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:46.394604 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-89f58b68-62fa-4728-8eba-3b4011327abd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:46.405647 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-49a74490-53bd-48e1-8cae-8f5ebb2a116e tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:46.418305 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-49a74490-53bd-48e1-8cae-8f5ebb2a116e tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.187764 Jun 07 13:14:46.420206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 102/188] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:46 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:46.546398 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-89f58b68-62fa-4728-8eba-3b4011327abd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:46.555190 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-89f58b68-62fa-4728-8eba-3b4011327abd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.177284 Jun 07 13:14:46.556005 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 87/189] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:46 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:46.629520 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ad35866b-83e1-48b9-9bfc-e675c03e2861 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:46.630219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ad35866b-83e1-48b9-9bfc-e675c03e2861 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:46.638143 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ad35866b-83e1-48b9-9bfc-e675c03e2861 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:46.638742 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ad35866b-83e1-48b9-9bfc-e675c03e2861 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:46.639754 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ad35866b-83e1-48b9-9bfc-e675c03e2861 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:46.640345 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ad35866b-83e1-48b9-9bfc-e675c03e2861 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:46.761322 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-fa53fe04-1114-4b97-b707-1c87b883fc6b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:46.761982 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-fa53fe04-1114-4b97-b707-1c87b883fc6b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:46.773700 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fa53fe04-1114-4b97-b707-1c87b883fc6b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:46.774513 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fa53fe04-1114-4b97-b707-1c87b883fc6b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:46.776284 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fa53fe04-1114-4b97-b707-1c87b883fc6b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:46.776879 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fa53fe04-1114-4b97-b707-1c87b883fc6b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:46.792955 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ad35866b-83e1-48b9-9bfc-e675c03e2861 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:46.801969 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ad35866b-83e1-48b9-9bfc-e675c03e2861 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.176781 Jun 07 13:14:46.802564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 103/190] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:46 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:46.932274 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-fa53fe04-1114-4b97-b707-1c87b883fc6b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:46.940370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-fa53fe04-1114-4b97-b707-1c87b883fc6b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.184333 Jun 07 13:14:46.949769 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 88/191] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:46 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:47.292110 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2724e2b5-910f-481d-8ed1-b691a6b95c57 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:47.292728 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2724e2b5-910f-481d-8ed1-b691a6b95c57 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:47.298760 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2724e2b5-910f-481d-8ed1-b691a6b95c57 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:47.299217 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2724e2b5-910f-481d-8ed1-b691a6b95c57 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:47.299981 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2724e2b5-910f-481d-8ed1-b691a6b95c57 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:47.300418 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2724e2b5-910f-481d-8ed1-b691a6b95c57 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:47.315032 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:47.361503 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2724e2b5-910f-481d-8ed1-b691a6b95c57 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:47.369679 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2724e2b5-910f-481d-8ed1-b691a6b95c57 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:47.371226 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2724e2b5-910f-481d-8ed1-b691a6b95c57 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:47.372319 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2724e2b5-910f-481d-8ed1-b691a6b95c57 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1339 microversion: 2.20 time: 0.084089 Jun 07 13:14:47.372906 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 104/192] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:47 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1339 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:14:47.442731 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5d50d933-bdad-4aaa-b83c-4aaa690972f0 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:47.443336 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5d50d933-bdad-4aaa-b83c-4aaa690972f0 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:47.449676 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5d50d933-bdad-4aaa-b83c-4aaa690972f0 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:47.450386 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5d50d933-bdad-4aaa-b83c-4aaa690972f0 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:47.451169 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5d50d933-bdad-4aaa-b83c-4aaa690972f0 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:47.451595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5d50d933-bdad-4aaa-b83c-4aaa690972f0 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:47.576084 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b5af4da3-869f-4574-b5dc-078f8e449dbd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:47.578018 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b5af4da3-869f-4574-b5dc-078f8e449dbd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:47.589156 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b5af4da3-869f-4574-b5dc-078f8e449dbd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:47.589156 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b5af4da3-869f-4574-b5dc-078f8e449dbd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:47.590592 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b5af4da3-869f-4574-b5dc-078f8e449dbd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:47.591031 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b5af4da3-869f-4574-b5dc-078f8e449dbd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:47.606173 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5d50d933-bdad-4aaa-b83c-4aaa690972f0 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:47.614993 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5d50d933-bdad-4aaa-b83c-4aaa690972f0 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.176094 Jun 07 13:14:47.615976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 89/193] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:47 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:47.765284 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b5af4da3-869f-4574-b5dc-078f8e449dbd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:47.772904 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b5af4da3-869f-4574-b5dc-078f8e449dbd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.203733 Jun 07 13:14:47.773999 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 105/194] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:47 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:47.836199 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e5a1203e-cfcc-4001-abfc-4706bb3011c5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:47.836830 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-e5a1203e-cfcc-4001-abfc-4706bb3011c5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:47.861487 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e5a1203e-cfcc-4001-abfc-4706bb3011c5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:47.862269 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e5a1203e-cfcc-4001-abfc-4706bb3011c5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:47.863260 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e5a1203e-cfcc-4001-abfc-4706bb3011c5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:47.864260 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e5a1203e-cfcc-4001-abfc-4706bb3011c5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:47.960080 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-20f6bb20-830e-4d15-b963-42bf6d04955e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:47.960820 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-20f6bb20-830e-4d15-b963-42bf6d04955e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:47.967646 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20f6bb20-830e-4d15-b963-42bf6d04955e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:47.968155 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20f6bb20-830e-4d15-b963-42bf6d04955e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:47.969273 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20f6bb20-830e-4d15-b963-42bf6d04955e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:47.978891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20f6bb20-830e-4d15-b963-42bf6d04955e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:48.023190 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e5a1203e-cfcc-4001-abfc-4706bb3011c5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:48.031524 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e5a1203e-cfcc-4001-abfc-4706bb3011c5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.215593 Jun 07 13:14:48.032191 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 90/195] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:47 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:48.118849 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-20f6bb20-830e-4d15-b963-42bf6d04955e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:48.127149 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-20f6bb20-830e-4d15-b963-42bf6d04955e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.172860 Jun 07 13:14:48.127749 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 106/196] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:47 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:48.390785 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-70725691-5c36-4c0c-bae2-58be0d0c2bcf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:48.391378 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-70725691-5c36-4c0c-bae2-58be0d0c2bcf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:48.397293 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-70725691-5c36-4c0c-bae2-58be0d0c2bcf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:48.397760 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-70725691-5c36-4c0c-bae2-58be0d0c2bcf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:48.398522 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-70725691-5c36-4c0c-bae2-58be0d0c2bcf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:48.398959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-70725691-5c36-4c0c-bae2-58be0d0c2bcf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:48.457977 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-70725691-5c36-4c0c-bae2-58be0d0c2bcf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:48.465783 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-70725691-5c36-4c0c-bae2-58be0d0c2bcf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:48.467327 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-70725691-5c36-4c0c-bae2-58be0d0c2bcf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:48.468416 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-70725691-5c36-4c0c-bae2-58be0d0c2bcf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1339 microversion: 2.20 time: 0.081535 Jun 07 13:14:48.469507 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 91/197] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:48 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1339 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:48.631937 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2c6f4df1-feda-4a65-904b-559d12b7a7b6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:48.632493 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2c6f4df1-feda-4a65-904b-559d12b7a7b6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:48.639502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2c6f4df1-feda-4a65-904b-559d12b7a7b6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:48.639945 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2c6f4df1-feda-4a65-904b-559d12b7a7b6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:48.641193 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2c6f4df1-feda-4a65-904b-559d12b7a7b6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:48.641616 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2c6f4df1-feda-4a65-904b-559d12b7a7b6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:48.763815 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2c6f4df1-feda-4a65-904b-559d12b7a7b6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:48.771553 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2c6f4df1-feda-4a65-904b-559d12b7a7b6 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.143661 Jun 07 13:14:48.772112 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 107/198] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:48 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:48.789075 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d842d0c9-fd24-4773-9878-a724c3904021 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:48.789685 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d842d0c9-fd24-4773-9878-a724c3904021 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:48.795560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d842d0c9-fd24-4773-9878-a724c3904021 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:48.796005 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d842d0c9-fd24-4773-9878-a724c3904021 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:48.796758 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d842d0c9-fd24-4773-9878-a724c3904021 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:48.797214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d842d0c9-fd24-4773-9878-a724c3904021 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:48.923153 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d842d0c9-fd24-4773-9878-a724c3904021 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:48.930370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d842d0c9-fd24-4773-9878-a724c3904021 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.145322 Jun 07 13:14:48.930952 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 92/199] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:48 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:49.047769 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fe6a6ac0-f0c0-4237-87ad-94b49a028f27 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:49.048386 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fe6a6ac0-f0c0-4237-87ad-94b49a028f27 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:49.054363 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fe6a6ac0-f0c0-4237-87ad-94b49a028f27 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:49.054846 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fe6a6ac0-f0c0-4237-87ad-94b49a028f27 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:49.055614 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fe6a6ac0-f0c0-4237-87ad-94b49a028f27 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:49.056051 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fe6a6ac0-f0c0-4237-87ad-94b49a028f27 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:49.143886 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1b979b8c-76dc-4880-ad68-0ebe969d66a6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:49.144588 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1b979b8c-76dc-4880-ad68-0ebe969d66a6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:49.150658 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1b979b8c-76dc-4880-ad68-0ebe969d66a6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:49.151179 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1b979b8c-76dc-4880-ad68-0ebe969d66a6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:49.152002 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1b979b8c-76dc-4880-ad68-0ebe969d66a6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:49.152506 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1b979b8c-76dc-4880-ad68-0ebe969d66a6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:49.188713 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fe6a6ac0-f0c0-4237-87ad-94b49a028f27 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:49.196191 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fe6a6ac0-f0c0-4237-87ad-94b49a028f27 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.152227 Jun 07 13:14:49.196770 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 108/200] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:49 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:49.281758 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1b979b8c-76dc-4880-ad68-0ebe969d66a6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:49.289372 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1b979b8c-76dc-4880-ad68-0ebe969d66a6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.149904 Jun 07 13:14:49.289939 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 93/201] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:49 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:49.487117 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-91cb054f-2e3e-4b34-a0ec-8e646fab45ac tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:49.487678 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-91cb054f-2e3e-4b34-a0ec-8e646fab45ac tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:49.493625 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-91cb054f-2e3e-4b34-a0ec-8e646fab45ac tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:49.494066 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-91cb054f-2e3e-4b34-a0ec-8e646fab45ac tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:49.494846 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-91cb054f-2e3e-4b34-a0ec-8e646fab45ac tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:49.495297 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-91cb054f-2e3e-4b34-a0ec-8e646fab45ac tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:49.554844 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-91cb054f-2e3e-4b34-a0ec-8e646fab45ac tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:49.563307 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-91cb054f-2e3e-4b34-a0ec-8e646fab45ac tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:49.564824 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-91cb054f-2e3e-4b34-a0ec-8e646fab45ac tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:49.565921 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-91cb054f-2e3e-4b34-a0ec-8e646fab45ac tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1339 microversion: 2.20 time: 0.083272 Jun 07 13:14:49.566487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 109/202] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:49 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1339 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:49.788873 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-4009e4a7-e8e1-4faf-ad22-96fa46703f57 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:49.789456 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-4009e4a7-e8e1-4faf-ad22-96fa46703f57 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:49.795707 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4009e4a7-e8e1-4faf-ad22-96fa46703f57 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:49.796149 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4009e4a7-e8e1-4faf-ad22-96fa46703f57 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:49.797787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4009e4a7-e8e1-4faf-ad22-96fa46703f57 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:49.798215 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4009e4a7-e8e1-4faf-ad22-96fa46703f57 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:49.922986 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-4009e4a7-e8e1-4faf-ad22-96fa46703f57 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:49.931017 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-4009e4a7-e8e1-4faf-ad22-96fa46703f57 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.146302 Jun 07 13:14:49.931578 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 94/203] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:49 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:49.947436 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0e54ec8c-efe9-4b10-be60-65ac71af76b8 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:49.948048 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0e54ec8c-efe9-4b10-be60-65ac71af76b8 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:49.954096 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0e54ec8c-efe9-4b10-be60-65ac71af76b8 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:49.954590 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0e54ec8c-efe9-4b10-be60-65ac71af76b8 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:49.955357 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0e54ec8c-efe9-4b10-be60-65ac71af76b8 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:49.955797 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0e54ec8c-efe9-4b10-be60-65ac71af76b8 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:50.080823 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0e54ec8c-efe9-4b10-be60-65ac71af76b8 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:50.088451 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0e54ec8c-efe9-4b10-be60-65ac71af76b8 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.144790 Jun 07 13:14:50.089214 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 110/204] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:49 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:50.213163 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-483bfbc0-40f0-4e59-8154-6d8e04a5f5a8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:50.213802 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-483bfbc0-40f0-4e59-8154-6d8e04a5f5a8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:50.220678 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-483bfbc0-40f0-4e59-8154-6d8e04a5f5a8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:50.221131 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-483bfbc0-40f0-4e59-8154-6d8e04a5f5a8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:50.221921 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-483bfbc0-40f0-4e59-8154-6d8e04a5f5a8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:50.222354 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-483bfbc0-40f0-4e59-8154-6d8e04a5f5a8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:50.236758 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:50.308332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-95f4445a-f935-4dcd-b845-a7bfd9336c0f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:50.308945 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-95f4445a-f935-4dcd-b845-a7bfd9336c0f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:50.315192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-95f4445a-f935-4dcd-b845-a7bfd9336c0f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:50.315647 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-95f4445a-f935-4dcd-b845-a7bfd9336c0f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:50.317105 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-95f4445a-f935-4dcd-b845-a7bfd9336c0f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:50.317192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-95f4445a-f935-4dcd-b845-a7bfd9336c0f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:50.348468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-483bfbc0-40f0-4e59-8154-6d8e04a5f5a8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:50.355918 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-483bfbc0-40f0-4e59-8154-6d8e04a5f5a8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.146530 Jun 07 13:14:50.358496 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 95/205] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:50 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:50.448018 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-95f4445a-f935-4dcd-b845-a7bfd9336c0f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:50.456180 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-95f4445a-f935-4dcd-b845-a7bfd9336c0f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.151655 Jun 07 13:14:50.456742 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 111/206] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:50 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:50.585049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3c5509e8-c1d0-41f0-a5cb-d8f8e81a249b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:50.585654 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3c5509e8-c1d0-41f0-a5cb-d8f8e81a249b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:50.591901 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3c5509e8-c1d0-41f0-a5cb-d8f8e81a249b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:50.592341 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3c5509e8-c1d0-41f0-a5cb-d8f8e81a249b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:50.593106 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3c5509e8-c1d0-41f0-a5cb-d8f8e81a249b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:50.593534 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3c5509e8-c1d0-41f0-a5cb-d8f8e81a249b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:50.658988 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3c5509e8-c1d0-41f0-a5cb-d8f8e81a249b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:50.667135 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3c5509e8-c1d0-41f0-a5cb-d8f8e81a249b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:50.668647 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3c5509e8-c1d0-41f0-a5cb-d8f8e81a249b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:50.669740 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3c5509e8-c1d0-41f0-a5cb-d8f8e81a249b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1339 microversion: 2.20 time: 0.088669 Jun 07 13:14:50.670299 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 96/207] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:50 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1339 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:50.948301 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-712a4d02-72b7-4a76-bf2b-90106a0cd325 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:50.948912 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-712a4d02-72b7-4a76-bf2b-90106a0cd325 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:50.954980 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-712a4d02-72b7-4a76-bf2b-90106a0cd325 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:50.955434 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-712a4d02-72b7-4a76-bf2b-90106a0cd325 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:50.956696 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-712a4d02-72b7-4a76-bf2b-90106a0cd325 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:50.957479 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-712a4d02-72b7-4a76-bf2b-90106a0cd325 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:51.094790 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-712a4d02-72b7-4a76-bf2b-90106a0cd325 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:51.102504 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-712a4d02-72b7-4a76-bf2b-90106a0cd325 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.157945 Jun 07 13:14:51.103067 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 112/208] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:50 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:51.105317 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0cb3d972-fcbb-4ecd-8b15-968b09ef21b5 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:51.105919 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0cb3d972-fcbb-4ecd-8b15-968b09ef21b5 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:51.112294 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0cb3d972-fcbb-4ecd-8b15-968b09ef21b5 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:51.112733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0cb3d972-fcbb-4ecd-8b15-968b09ef21b5 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:51.113478 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0cb3d972-fcbb-4ecd-8b15-968b09ef21b5 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:51.113907 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0cb3d972-fcbb-4ecd-8b15-968b09ef21b5 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:51.241005 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0cb3d972-fcbb-4ecd-8b15-968b09ef21b5 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:51.248863 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0cb3d972-fcbb-4ecd-8b15-968b09ef21b5 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.147361 Jun 07 13:14:51.249432 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 97/209] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:51 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:51.372914 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-34b87321-f13a-4a06-8bae-f1bdd4509fdf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:51.373521 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-34b87321-f13a-4a06-8bae-f1bdd4509fdf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:51.379530 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-34b87321-f13a-4a06-8bae-f1bdd4509fdf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:51.379980 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-34b87321-f13a-4a06-8bae-f1bdd4509fdf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:51.380737 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-34b87321-f13a-4a06-8bae-f1bdd4509fdf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:51.381169 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-34b87321-f13a-4a06-8bae-f1bdd4509fdf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:51.472610 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-393c94e2-0de7-42a4-9e3e-ee1c6546be43 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:51.473229 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-393c94e2-0de7-42a4-9e3e-ee1c6546be43 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:51.479296 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-393c94e2-0de7-42a4-9e3e-ee1c6546be43 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:51.479749 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-393c94e2-0de7-42a4-9e3e-ee1c6546be43 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:51.480589 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-393c94e2-0de7-42a4-9e3e-ee1c6546be43 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:51.481026 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-393c94e2-0de7-42a4-9e3e-ee1c6546be43 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:51.510209 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-34b87321-f13a-4a06-8bae-f1bdd4509fdf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:51.518276 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-34b87321-f13a-4a06-8bae-f1bdd4509fdf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.149111 Jun 07 13:14:51.518876 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 113/210] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:51 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:51.605228 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-393c94e2-0de7-42a4-9e3e-ee1c6546be43 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:51.612561 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-393c94e2-0de7-42a4-9e3e-ee1c6546be43 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.144265 Jun 07 13:14:51.613166 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 98/211] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:51 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:51.687189 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d0bb5b7c-757a-434c-810a-51d46c886468 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:51.687789 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d0bb5b7c-757a-434c-810a-51d46c886468 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:51.693724 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d0bb5b7c-757a-434c-810a-51d46c886468 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:51.694164 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d0bb5b7c-757a-434c-810a-51d46c886468 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:51.694952 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d0bb5b7c-757a-434c-810a-51d46c886468 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:51.695379 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d0bb5b7c-757a-434c-810a-51d46c886468 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:51.754142 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d0bb5b7c-757a-434c-810a-51d46c886468 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:51.761836 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d0bb5b7c-757a-434c-810a-51d46c886468 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:51.763355 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d0bb5b7c-757a-434c-810a-51d46c886468 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:51.764429 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d0bb5b7c-757a-434c-810a-51d46c886468 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1339 microversion: 2.20 time: 0.081062 Jun 07 13:14:51.764979 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 114/212] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:51 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1339 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:52.119213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a5031e6d-f16e-41f5-af41-792b13b3236b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:52.119814 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a5031e6d-f16e-41f5-af41-792b13b3236b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:52.126193 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a5031e6d-f16e-41f5-af41-792b13b3236b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:52.126667 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a5031e6d-f16e-41f5-af41-792b13b3236b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:52.127502 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a5031e6d-f16e-41f5-af41-792b13b3236b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:52.127932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a5031e6d-f16e-41f5-af41-792b13b3236b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:52.265272 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b4d483ca-1eb9-42fe-84ed-4eccd15295e0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:52.266494 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b4d483ca-1eb9-42fe-84ed-4eccd15295e0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:52.272696 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b4d483ca-1eb9-42fe-84ed-4eccd15295e0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:52.273138 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b4d483ca-1eb9-42fe-84ed-4eccd15295e0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:52.273905 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b4d483ca-1eb9-42fe-84ed-4eccd15295e0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:52.274332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b4d483ca-1eb9-42fe-84ed-4eccd15295e0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:52.405572 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b4d483ca-1eb9-42fe-84ed-4eccd15295e0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:52.413209 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b4d483ca-1eb9-42fe-84ed-4eccd15295e0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.151879 Jun 07 13:14:52.413777 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 115/213] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:52 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:52.427108 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a5031e6d-f16e-41f5-af41-792b13b3236b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:52.434409 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a5031e6d-f16e-41f5-af41-792b13b3236b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.318952 Jun 07 13:14:52.434985 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 99/214] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:52 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:52.534554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3de5a948-c8a6-4d3b-9799-9707bc2cfbea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:52.535165 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3de5a948-c8a6-4d3b-9799-9707bc2cfbea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:52.541288 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3de5a948-c8a6-4d3b-9799-9707bc2cfbea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:52.541739 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3de5a948-c8a6-4d3b-9799-9707bc2cfbea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:52.542534 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3de5a948-c8a6-4d3b-9799-9707bc2cfbea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:52.542976 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3de5a948-c8a6-4d3b-9799-9707bc2cfbea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:52.629516 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a34c45ff-96df-4d50-af47-60b6fdae487e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:52.630053 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a34c45ff-96df-4d50-af47-60b6fdae487e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:52.636207 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a34c45ff-96df-4d50-af47-60b6fdae487e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:52.636643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a34c45ff-96df-4d50-af47-60b6fdae487e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:52.637392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a34c45ff-96df-4d50-af47-60b6fdae487e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:52.637814 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a34c45ff-96df-4d50-af47-60b6fdae487e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:52.674057 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3de5a948-c8a6-4d3b-9799-9707bc2cfbea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:52.681567 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3de5a948-c8a6-4d3b-9799-9707bc2cfbea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.150835 Jun 07 13:14:52.682130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 116/215] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:52 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:52.762303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a34c45ff-96df-4d50-af47-60b6fdae487e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:52.769653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a34c45ff-96df-4d50-af47-60b6fdae487e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.144589 Jun 07 13:14:52.770212 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 100/216] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:52 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:52.782764 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1329ae98-61ef-4b1a-9fca-432c2b5ab611 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:52.783372 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1329ae98-61ef-4b1a-9fca-432c2b5ab611 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:52.789514 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1329ae98-61ef-4b1a-9fca-432c2b5ab611 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:52.789958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1329ae98-61ef-4b1a-9fca-432c2b5ab611 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:52.790745 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1329ae98-61ef-4b1a-9fca-432c2b5ab611 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:52.791180 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1329ae98-61ef-4b1a-9fca-432c2b5ab611 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:52.850979 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1329ae98-61ef-4b1a-9fca-432c2b5ab611 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:52.858881 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1329ae98-61ef-4b1a-9fca-432c2b5ab611 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:52.861023 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1329ae98-61ef-4b1a-9fca-432c2b5ab611 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:52.862107 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1329ae98-61ef-4b1a-9fca-432c2b5ab611 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1339 microversion: 2.20 time: 0.083714 Jun 07 13:14:52.862702 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 117/217] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:52 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1339 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:53.430350 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-70222396-4158-41d9-b113-e22d25965744 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:53.430971 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-70222396-4158-41d9-b113-e22d25965744 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:53.437009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-70222396-4158-41d9-b113-e22d25965744 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:53.437959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-70222396-4158-41d9-b113-e22d25965744 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:53.438773 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-70222396-4158-41d9-b113-e22d25965744 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:53.439205 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-70222396-4158-41d9-b113-e22d25965744 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:53.451156 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-964696b4-6388-4409-90ba-fa11499afe02 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:53.451773 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-964696b4-6388-4409-90ba-fa11499afe02 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:53.458721 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-964696b4-6388-4409-90ba-fa11499afe02 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:53.459181 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-964696b4-6388-4409-90ba-fa11499afe02 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:53.459957 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-964696b4-6388-4409-90ba-fa11499afe02 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:53.460392 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-964696b4-6388-4409-90ba-fa11499afe02 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:53.594163 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-70222396-4158-41d9-b113-e22d25965744 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:53.602125 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-70222396-4158-41d9-b113-e22d25965744 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.175519 Jun 07 13:14:53.603494 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 101/218] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:53 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:53.670040 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-964696b4-6388-4409-90ba-fa11499afe02 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:53.679324 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-964696b4-6388-4409-90ba-fa11499afe02 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.231797 Jun 07 13:14:53.693553 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 118/219] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:53 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:53.702134 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9a68bfb7-5e56-4517-afd9-b12d1a58cea9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:53.702808 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9a68bfb7-5e56-4517-afd9-b12d1a58cea9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:53.710049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9a68bfb7-5e56-4517-afd9-b12d1a58cea9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:53.710509 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9a68bfb7-5e56-4517-afd9-b12d1a58cea9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:53.711272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9a68bfb7-5e56-4517-afd9-b12d1a58cea9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:53.711699 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9a68bfb7-5e56-4517-afd9-b12d1a58cea9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:53.786806 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-737895a3-3081-493c-95d8-c13854b881c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:53.787508 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-737895a3-3081-493c-95d8-c13854b881c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:53.805011 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-737895a3-3081-493c-95d8-c13854b881c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:53.805749 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-737895a3-3081-493c-95d8-c13854b881c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:53.811949 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-737895a3-3081-493c-95d8-c13854b881c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:53.813469 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-737895a3-3081-493c-95d8-c13854b881c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:54.005601 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9a68bfb7-5e56-4517-afd9-b12d1a58cea9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:54.016436 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9a68bfb7-5e56-4517-afd9-b12d1a58cea9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.320686 Jun 07 13:14:54.017027 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 102/220] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:53 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:54.031675 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a33d9285-8262-48a4-86c4-4909dbb44f2e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:54.032462 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a33d9285-8262-48a4-86c4-4909dbb44f2e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:54.040022 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a33d9285-8262-48a4-86c4-4909dbb44f2e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:54.040628 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a33d9285-8262-48a4-86c4-4909dbb44f2e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:54.041795 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a33d9285-8262-48a4-86c4-4909dbb44f2e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:54.042380 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a33d9285-8262-48a4-86c4-4909dbb44f2e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:54.155512 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-737895a3-3081-493c-95d8-c13854b881c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:54.164444 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-737895a3-3081-493c-95d8-c13854b881c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.382095 Jun 07 13:14:54.190224 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 119/221] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:53 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:54.229841 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a33d9285-8262-48a4-86c4-4909dbb44f2e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:54.239656 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a33d9285-8262-48a4-86c4-4909dbb44f2e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:54.241208 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a33d9285-8262-48a4-86c4-4909dbb44f2e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:54.242256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a33d9285-8262-48a4-86c4-4909dbb44f2e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.214829 Jun 07 13:14:54.242847 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 103/222] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:54 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:54.619630 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-90b1d340-2a9c-4736-bfb7-47e269d24efc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:54.620260 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-90b1d340-2a9c-4736-bfb7-47e269d24efc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:54.626717 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-90b1d340-2a9c-4736-bfb7-47e269d24efc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:54.627521 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-90b1d340-2a9c-4736-bfb7-47e269d24efc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:54.628348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-90b1d340-2a9c-4736-bfb7-47e269d24efc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:54.628791 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-90b1d340-2a9c-4736-bfb7-47e269d24efc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:54.700503 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b9448aef-5750-4ea8-b657-28d1e6ec383f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:54.701107 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b9448aef-5750-4ea8-b657-28d1e6ec383f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:54.707778 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b9448aef-5750-4ea8-b657-28d1e6ec383f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:54.708218 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b9448aef-5750-4ea8-b657-28d1e6ec383f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:54.708981 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b9448aef-5750-4ea8-b657-28d1e6ec383f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:54.709406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b9448aef-5750-4ea8-b657-28d1e6ec383f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:54.773602 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-90b1d340-2a9c-4736-bfb7-47e269d24efc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:54.781555 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-90b1d340-2a9c-4736-bfb7-47e269d24efc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.165332 Jun 07 13:14:54.782133 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 120/223] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:54 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:54.840623 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b9448aef-5750-4ea8-b657-28d1e6ec383f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:54.850387 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b9448aef-5750-4ea8-b657-28d1e6ec383f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.153374 Jun 07 13:14:54.851528 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 104/224] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:54 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:55.033030 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8b567f6a-a0a4-468c-abad-db3c758161b5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:55.033548 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8b567f6a-a0a4-468c-abad-db3c758161b5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:55.039781 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8b567f6a-a0a4-468c-abad-db3c758161b5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:55.040225 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8b567f6a-a0a4-468c-abad-db3c758161b5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:55.040974 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8b567f6a-a0a4-468c-abad-db3c758161b5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:55.041406 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8b567f6a-a0a4-468c-abad-db3c758161b5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:55.043927 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:55.174044 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8b567f6a-a0a4-468c-abad-db3c758161b5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:55.181345 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-cb018fbe-342e-4425-8dc5-deae9f9fb4d6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:55.181525 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8b567f6a-a0a4-468c-abad-db3c758161b5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.152406 Jun 07 13:14:55.182090 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 121/225] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:55 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:55.182215 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-cb018fbe-342e-4425-8dc5-deae9f9fb4d6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:55.199405 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cb018fbe-342e-4425-8dc5-deae9f9fb4d6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:55.199935 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cb018fbe-342e-4425-8dc5-deae9f9fb4d6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:55.200879 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cb018fbe-342e-4425-8dc5-deae9f9fb4d6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:55.201375 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cb018fbe-342e-4425-8dc5-deae9f9fb4d6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:55.260681 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5d2ffe42-c35e-4270-96d4-7eab17acc61d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:55.261283 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5d2ffe42-c35e-4270-96d4-7eab17acc61d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:55.268033 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5d2ffe42-c35e-4270-96d4-7eab17acc61d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:55.268866 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5d2ffe42-c35e-4270-96d4-7eab17acc61d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:55.269853 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5d2ffe42-c35e-4270-96d4-7eab17acc61d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:55.270429 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5d2ffe42-c35e-4270-96d4-7eab17acc61d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:55.348059 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cb018fbe-342e-4425-8dc5-deae9f9fb4d6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:55.357369 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-cb018fbe-342e-4425-8dc5-deae9f9fb4d6 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.179703 Jun 07 13:14:55.357942 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 105/226] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:55 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:55.438403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5d2ffe42-c35e-4270-96d4-7eab17acc61d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:55.446654 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5d2ffe42-c35e-4270-96d4-7eab17acc61d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:55.448551 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5d2ffe42-c35e-4270-96d4-7eab17acc61d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:55.449720 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5d2ffe42-c35e-4270-96d4-7eab17acc61d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.193384 Jun 07 13:14:55.450276 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 122/227] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:55 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:14:55.799269 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-94e4a25f-bab7-4bc1-aedd-64efbb5bd9e9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:55.799880 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-94e4a25f-bab7-4bc1-aedd-64efbb5bd9e9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:55.806242 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-94e4a25f-bab7-4bc1-aedd-64efbb5bd9e9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:55.806719 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-94e4a25f-bab7-4bc1-aedd-64efbb5bd9e9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:55.807487 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-94e4a25f-bab7-4bc1-aedd-64efbb5bd9e9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:55.807926 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-94e4a25f-bab7-4bc1-aedd-64efbb5bd9e9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:55.871341 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c6d6b763-c0c2-4d8e-b31a-f0eefec41f1a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:55.872044 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c6d6b763-c0c2-4d8e-b31a-f0eefec41f1a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:55.878050 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c6d6b763-c0c2-4d8e-b31a-f0eefec41f1a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:55.878864 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c6d6b763-c0c2-4d8e-b31a-f0eefec41f1a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:55.879633 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c6d6b763-c0c2-4d8e-b31a-f0eefec41f1a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:55.880072 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c6d6b763-c0c2-4d8e-b31a-f0eefec41f1a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:55.939939 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-94e4a25f-bab7-4bc1-aedd-64efbb5bd9e9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:55.948227 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-94e4a25f-bab7-4bc1-aedd-64efbb5bd9e9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.153515 Jun 07 13:14:55.949016 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 106/228] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:55 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:56.011337 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c6d6b763-c0c2-4d8e-b31a-f0eefec41f1a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:56.019333 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c6d6b763-c0c2-4d8e-b31a-f0eefec41f1a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.151901 Jun 07 13:14:56.019904 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 123/229] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:55 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:56.079999 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-e21d0d64-6d12-4955-b653-fdd0d9b794c5 req-e25ffea6-8c79-4682-8738-8501b0d2204e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972b9306-4700-4212-ba99-0654d90e4348", "name": "network-vif-plugged", "status": "completed", "tag": "46af4bbe-8074-4168-ad35-f13ba7b7a236"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:56.088138 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-e21d0d64-6d12-4955-b653-fdd0d9b794c5 req-e25ffea6-8c79-4682-8738-8501b0d2204e service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:56.088583 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-e21d0d64-6d12-4955-b653-fdd0d9b794c5 req-e25ffea6-8c79-4682-8738-8501b0d2204e service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:56.102717 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-e21d0d64-6d12-4955-b653-fdd0d9b794c5 req-e25ffea6-8c79-4682-8738-8501b0d2204e service nova] Creating event network-vif-plugged:46af4bbe-8074-4168-ad35-f13ba7b7a236 for instance 972b9306-4700-4212-ba99-0654d90e4348 on hv-cinder-84496 Jun 07 13:14:56.107597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-e21d0d64-6d12-4955-b653-fdd0d9b794c5 req-e25ffea6-8c79-4682-8738-8501b0d2204e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031838 Jun 07 13:14:56.108186 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 107/230] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:14:56.198862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2cfd5d71-5f32-47af-97b9-23cdb75f0bf2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:56.199522 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2cfd5d71-5f32-47af-97b9-23cdb75f0bf2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:56.201619 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:56.208566 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2cfd5d71-5f32-47af-97b9-23cdb75f0bf2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:56.209221 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2cfd5d71-5f32-47af-97b9-23cdb75f0bf2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:56.210010 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2cfd5d71-5f32-47af-97b9-23cdb75f0bf2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:56.210709 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2cfd5d71-5f32-47af-97b9-23cdb75f0bf2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:56.344432 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2cfd5d71-5f32-47af-97b9-23cdb75f0bf2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:56.352105 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2cfd5d71-5f32-47af-97b9-23cdb75f0bf2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.157427 Jun 07 13:14:56.352669 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 124/231] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:56 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:56.375327 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-da723e1c-fc3b-4f5a-a289-e72d3dc4758f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:56.376028 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-da723e1c-fc3b-4f5a-a289-e72d3dc4758f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:56.382148 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-da723e1c-fc3b-4f5a-a289-e72d3dc4758f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:56.382641 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-da723e1c-fc3b-4f5a-a289-e72d3dc4758f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:56.383400 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-da723e1c-fc3b-4f5a-a289-e72d3dc4758f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:56.383903 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-da723e1c-fc3b-4f5a-a289-e72d3dc4758f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:56.468039 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-784fe1c9-c021-42b1-a20d-b569ef372706 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:56.468762 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-784fe1c9-c021-42b1-a20d-b569ef372706 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:56.475090 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-784fe1c9-c021-42b1-a20d-b569ef372706 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:56.475643 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-784fe1c9-c021-42b1-a20d-b569ef372706 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:56.476503 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-784fe1c9-c021-42b1-a20d-b569ef372706 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:56.477047 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-784fe1c9-c021-42b1-a20d-b569ef372706 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:56.536835 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-da723e1c-fc3b-4f5a-a289-e72d3dc4758f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:56.544987 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-da723e1c-fc3b-4f5a-a289-e72d3dc4758f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.173640 Jun 07 13:14:56.555179 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 108/232] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:56 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:56.633948 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-784fe1c9-c021-42b1-a20d-b569ef372706 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:56.643162 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-784fe1c9-c021-42b1-a20d-b569ef372706 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:56.644680 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-784fe1c9-c021-42b1-a20d-b569ef372706 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:56.645786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-784fe1c9-c021-42b1-a20d-b569ef372706 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.181911 Jun 07 13:14:56.646348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 125/233] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:56 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:56.964904 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c8285e07-9a6d-4656-b02d-167cea9e2327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:56.965511 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c8285e07-9a6d-4656-b02d-167cea9e2327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:56.967505 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:56.973072 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c8285e07-9a6d-4656-b02d-167cea9e2327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:56.973526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c8285e07-9a6d-4656-b02d-167cea9e2327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:56.974321 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c8285e07-9a6d-4656-b02d-167cea9e2327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:56.974834 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c8285e07-9a6d-4656-b02d-167cea9e2327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:57.037018 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1633d8fb-309c-4eff-b285-ebaf7cad1cc3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:57.037635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1633d8fb-309c-4eff-b285-ebaf7cad1cc3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:57.043844 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1633d8fb-309c-4eff-b285-ebaf7cad1cc3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:57.044289 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1633d8fb-309c-4eff-b285-ebaf7cad1cc3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:57.045061 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1633d8fb-309c-4eff-b285-ebaf7cad1cc3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:57.045494 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1633d8fb-309c-4eff-b285-ebaf7cad1cc3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:57.105329 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c8285e07-9a6d-4656-b02d-167cea9e2327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:57.113190 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c8285e07-9a6d-4656-b02d-167cea9e2327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.152129 Jun 07 13:14:57.113761 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 109/234] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:56 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:57.175390 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1633d8fb-309c-4eff-b285-ebaf7cad1cc3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:57.182755 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1633d8fb-309c-4eff-b285-ebaf7cad1cc3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.149801 Jun 07 13:14:57.183322 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 126/235] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:57 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:57.367877 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-203fe833-a7e8-48f3-bedf-10077233d3d7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:57.368449 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-203fe833-a7e8-48f3-bedf-10077233d3d7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:57.374362 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-203fe833-a7e8-48f3-bedf-10077233d3d7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:57.374870 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-203fe833-a7e8-48f3-bedf-10077233d3d7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:57.375629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-203fe833-a7e8-48f3-bedf-10077233d3d7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:57.376072 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-203fe833-a7e8-48f3-bedf-10077233d3d7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:57.501057 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-203fe833-a7e8-48f3-bedf-10077233d3d7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:57.508660 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-203fe833-a7e8-48f3-bedf-10077233d3d7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.144628 Jun 07 13:14:57.509221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 110/236] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:57 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:57.562041 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-64d961c5-f088-4061-b2c4-f342b102a42f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:57.562674 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-64d961c5-f088-4061-b2c4-f342b102a42f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:57.568658 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64d961c5-f088-4061-b2c4-f342b102a42f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:57.569092 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64d961c5-f088-4061-b2c4-f342b102a42f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:57.569839 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64d961c5-f088-4061-b2c4-f342b102a42f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:57.570264 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64d961c5-f088-4061-b2c4-f342b102a42f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:57.663893 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f6fce421-ace7-4976-8243-968445abe8ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:57.664491 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f6fce421-ace7-4976-8243-968445abe8ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:57.670621 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f6fce421-ace7-4976-8243-968445abe8ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:57.671069 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f6fce421-ace7-4976-8243-968445abe8ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:57.671814 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f6fce421-ace7-4976-8243-968445abe8ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:57.672237 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f6fce421-ace7-4976-8243-968445abe8ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:57.695850 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-64d961c5-f088-4061-b2c4-f342b102a42f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:57.704066 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-64d961c5-f088-4061-b2c4-f342b102a42f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.145820 Jun 07 13:14:57.704633 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 127/237] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:57 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:57.801318 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f6fce421-ace7-4976-8243-968445abe8ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:57.809317 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f6fce421-ace7-4976-8243-968445abe8ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:57.810860 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f6fce421-ace7-4976-8243-968445abe8ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:57.811943 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f6fce421-ace7-4976-8243-968445abe8ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.152173 Jun 07 13:14:57.812494 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 111/238] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:57 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:14:58.130196 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fb8404e0-b8fb-43f1-9d6d-1cc9b5924219 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:58.130833 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fb8404e0-b8fb-43f1-9d6d-1cc9b5924219 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:58.136914 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb8404e0-b8fb-43f1-9d6d-1cc9b5924219 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:58.137368 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb8404e0-b8fb-43f1-9d6d-1cc9b5924219 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:58.138130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb8404e0-b8fb-43f1-9d6d-1cc9b5924219 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:58.138606 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb8404e0-b8fb-43f1-9d6d-1cc9b5924219 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:58.199328 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ee2ded1e-6f9f-4e77-8d21-ed734093f1cd tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:58.199937 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ee2ded1e-6f9f-4e77-8d21-ed734093f1cd tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:58.206545 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ee2ded1e-6f9f-4e77-8d21-ed734093f1cd tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:58.207025 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ee2ded1e-6f9f-4e77-8d21-ed734093f1cd tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:58.207793 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ee2ded1e-6f9f-4e77-8d21-ed734093f1cd tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:58.208228 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ee2ded1e-6f9f-4e77-8d21-ed734093f1cd tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:58.262222 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fb8404e0-b8fb-43f1-9d6d-1cc9b5924219 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:58.270217 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fb8404e0-b8fb-43f1-9d6d-1cc9b5924219 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.143837 Jun 07 13:14:58.270816 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 128/239] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:58 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:58.338686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ee2ded1e-6f9f-4e77-8d21-ed734093f1cd tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:58.340911 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:58.347132 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ee2ded1e-6f9f-4e77-8d21-ed734093f1cd tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.151622 Jun 07 13:14:58.347701 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 112/240] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:58 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:58.525592 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-88aee711-100f-489c-a0d4-54af56d254e0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:58.526332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-88aee711-100f-489c-a0d4-54af56d254e0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:58.532702 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-88aee711-100f-489c-a0d4-54af56d254e0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:58.533154 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-88aee711-100f-489c-a0d4-54af56d254e0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:58.534071 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-88aee711-100f-489c-a0d4-54af56d254e0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:58.534555 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-88aee711-100f-489c-a0d4-54af56d254e0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:58.670666 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-88aee711-100f-489c-a0d4-54af56d254e0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:58.678580 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-88aee711-100f-489c-a0d4-54af56d254e0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.157288 Jun 07 13:14:58.679138 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 129/241] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:58 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:58.721058 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e2e3aec9-1e43-4799-a5fd-7f82380cc70d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:58.721687 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-e2e3aec9-1e43-4799-a5fd-7f82380cc70d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:58.727587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e2e3aec9-1e43-4799-a5fd-7f82380cc70d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:58.728026 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e2e3aec9-1e43-4799-a5fd-7f82380cc70d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:58.728770 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e2e3aec9-1e43-4799-a5fd-7f82380cc70d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:58.729194 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e2e3aec9-1e43-4799-a5fd-7f82380cc70d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:58.831552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3b6be781-06a5-4dd8-8643-eabb52e7b5dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:58.832157 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3b6be781-06a5-4dd8-8643-eabb52e7b5dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:58.839745 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3b6be781-06a5-4dd8-8643-eabb52e7b5dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:58.840192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3b6be781-06a5-4dd8-8643-eabb52e7b5dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:58.840952 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3b6be781-06a5-4dd8-8643-eabb52e7b5dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:58.841384 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3b6be781-06a5-4dd8-8643-eabb52e7b5dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:58.862534 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e2e3aec9-1e43-4799-a5fd-7f82380cc70d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:58.869922 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e2e3aec9-1e43-4799-a5fd-7f82380cc70d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.153128 Jun 07 13:14:58.870508 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 113/242] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:58 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:58.971979 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3b6be781-06a5-4dd8-8643-eabb52e7b5dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:58.979931 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3b6be781-06a5-4dd8-8643-eabb52e7b5dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:58.981444 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3b6be781-06a5-4dd8-8643-eabb52e7b5dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:58.982588 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3b6be781-06a5-4dd8-8643-eabb52e7b5dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.154949 Jun 07 13:14:58.983155 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 130/243] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:58 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:14:59.288424 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ee45fe0b-8135-43cc-a5f8-7fda5b24d6e3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:59.289037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ee45fe0b-8135-43cc-a5f8-7fda5b24d6e3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:59.299164 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ee45fe0b-8135-43cc-a5f8-7fda5b24d6e3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:59.299615 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ee45fe0b-8135-43cc-a5f8-7fda5b24d6e3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:59.300371 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ee45fe0b-8135-43cc-a5f8-7fda5b24d6e3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:59.300805 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ee45fe0b-8135-43cc-a5f8-7fda5b24d6e3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:59.363884 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8b289b04-2773-4dc2-b3d0-e1e47b773998 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:59.364493 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8b289b04-2773-4dc2-b3d0-e1e47b773998 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:59.370354 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8b289b04-2773-4dc2-b3d0-e1e47b773998 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:59.370837 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8b289b04-2773-4dc2-b3d0-e1e47b773998 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:59.371591 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8b289b04-2773-4dc2-b3d0-e1e47b773998 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:59.372021 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8b289b04-2773-4dc2-b3d0-e1e47b773998 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:59.433115 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ee45fe0b-8135-43cc-a5f8-7fda5b24d6e3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:59.441003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ee45fe0b-8135-43cc-a5f8-7fda5b24d6e3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.156675 Jun 07 13:14:59.441579 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 114/244] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:59 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:59.500326 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8b289b04-2773-4dc2-b3d0-e1e47b773998 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:59.507622 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8b289b04-2773-4dc2-b3d0-e1e47b773998 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.147510 Jun 07 13:14:59.508179 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 131/245] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:59 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:59.694847 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f3e04acd-42f6-4261-8803-4b8830903c08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:59.695378 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f3e04acd-42f6-4261-8803-4b8830903c08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:59.701275 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f3e04acd-42f6-4261-8803-4b8830903c08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:59.701714 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f3e04acd-42f6-4261-8803-4b8830903c08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:59.702468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f3e04acd-42f6-4261-8803-4b8830903c08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:59.703562 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f3e04acd-42f6-4261-8803-4b8830903c08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:59.826250 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f3e04acd-42f6-4261-8803-4b8830903c08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:59.833664 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f3e04acd-42f6-4261-8803-4b8830903c08 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.142573 Jun 07 13:14:59.834215 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 115/246] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:59 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:59.887065 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fdd3896e-5848-4836-a866-60dc89778cc1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:59.887699 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fdd3896e-5848-4836-a866-60dc89778cc1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:59.894065 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fdd3896e-5848-4836-a866-60dc89778cc1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:59.894597 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fdd3896e-5848-4836-a866-60dc89778cc1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:59.895419 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fdd3896e-5848-4836-a866-60dc89778cc1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:59.895875 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fdd3896e-5848-4836-a866-60dc89778cc1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:00.002109 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-557ddbf1-2e4e-4f15-ae73-9a0cdfef13d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:00.002731 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-557ddbf1-2e4e-4f15-ae73-9a0cdfef13d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:00.008584 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-557ddbf1-2e4e-4f15-ae73-9a0cdfef13d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:00.009064 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-557ddbf1-2e4e-4f15-ae73-9a0cdfef13d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:00.009824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-557ddbf1-2e4e-4f15-ae73-9a0cdfef13d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:00.010256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-557ddbf1-2e4e-4f15-ae73-9a0cdfef13d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:00.023719 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fdd3896e-5848-4836-a866-60dc89778cc1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:00.034871 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fdd3896e-5848-4836-a866-60dc89778cc1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.151758 Jun 07 13:15:00.035651 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 132/247] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:59 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:00.142387 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-557ddbf1-2e4e-4f15-ae73-9a0cdfef13d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:00.150245 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-557ddbf1-2e4e-4f15-ae73-9a0cdfef13d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:00.151783 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-557ddbf1-2e4e-4f15-ae73-9a0cdfef13d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:00.152864 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-557ddbf1-2e4e-4f15-ae73-9a0cdfef13d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.155559 Jun 07 13:15:00.153411 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 116/248] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:14:59 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:00.458217 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f1623d28-84b7-42cb-a77b-6800028efb1a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:00.458960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f1623d28-84b7-42cb-a77b-6800028efb1a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:00.465336 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f1623d28-84b7-42cb-a77b-6800028efb1a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:00.465817 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f1623d28-84b7-42cb-a77b-6800028efb1a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:00.466697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f1623d28-84b7-42cb-a77b-6800028efb1a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:00.467235 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f1623d28-84b7-42cb-a77b-6800028efb1a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:00.525180 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-4776d229-b4be-4a8e-833e-5a3a4e5b29ce tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:00.525894 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-4776d229-b4be-4a8e-833e-5a3a4e5b29ce tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:00.532971 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4776d229-b4be-4a8e-833e-5a3a4e5b29ce tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:00.533485 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4776d229-b4be-4a8e-833e-5a3a4e5b29ce tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:00.534329 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4776d229-b4be-4a8e-833e-5a3a4e5b29ce tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:00.534784 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4776d229-b4be-4a8e-833e-5a3a4e5b29ce tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:00.598253 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f1623d28-84b7-42cb-a77b-6800028efb1a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:00.606020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f1623d28-84b7-42cb-a77b-6800028efb1a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.151803 Jun 07 13:15:00.615572 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 133/249] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:00 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:00.674746 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-4776d229-b4be-4a8e-833e-5a3a4e5b29ce tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:00.682099 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-4776d229-b4be-4a8e-833e-5a3a4e5b29ce tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.160806 Jun 07 13:15:00.682698 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 117/250] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:00 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:00.849577 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-28b296e2-9899-4c73-9061-7c2333028e44 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:00.850190 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-28b296e2-9899-4c73-9061-7c2333028e44 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:00.856170 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-28b296e2-9899-4c73-9061-7c2333028e44 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:00.856608 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-28b296e2-9899-4c73-9061-7c2333028e44 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:00.857361 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-28b296e2-9899-4c73-9061-7c2333028e44 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:00.857795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-28b296e2-9899-4c73-9061-7c2333028e44 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:00.987987 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-28b296e2-9899-4c73-9061-7c2333028e44 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:00.995404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-28b296e2-9899-4c73-9061-7c2333028e44 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.149640 Jun 07 13:15:00.995962 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 134/251] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:00 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:01.052043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-09e33a7e-a82d-4190-a477-a41ff42bde6f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:01.052682 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-09e33a7e-a82d-4190-a477-a41ff42bde6f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:01.058594 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-09e33a7e-a82d-4190-a477-a41ff42bde6f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:01.059053 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-09e33a7e-a82d-4190-a477-a41ff42bde6f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:01.059811 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-09e33a7e-a82d-4190-a477-a41ff42bde6f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:01.060251 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-09e33a7e-a82d-4190-a477-a41ff42bde6f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:01.171055 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-21fc7a47-5f2b-4b3d-b39a-4c6ee800968c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:01.171802 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-21fc7a47-5f2b-4b3d-b39a-4c6ee800968c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:01.177827 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21fc7a47-5f2b-4b3d-b39a-4c6ee800968c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:01.178288 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21fc7a47-5f2b-4b3d-b39a-4c6ee800968c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:01.179053 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21fc7a47-5f2b-4b3d-b39a-4c6ee800968c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:01.179477 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21fc7a47-5f2b-4b3d-b39a-4c6ee800968c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:01.190670 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-09e33a7e-a82d-4190-a477-a41ff42bde6f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:01.199319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-09e33a7e-a82d-4190-a477-a41ff42bde6f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.150951 Jun 07 13:15:01.200148 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 118/252] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:01 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:01.307536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-21fc7a47-5f2b-4b3d-b39a-4c6ee800968c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:01.316305 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-21fc7a47-5f2b-4b3d-b39a-4c6ee800968c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:01.317818 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-21fc7a47-5f2b-4b3d-b39a-4c6ee800968c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:01.319028 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-21fc7a47-5f2b-4b3d-b39a-4c6ee800968c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.151881 Jun 07 13:15:01.319590 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 135/253] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:01 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:15:01.621914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1094f94f-e065-4daa-93f7-93f305fa6eb4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:01.622550 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1094f94f-e065-4daa-93f7-93f305fa6eb4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:01.629003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1094f94f-e065-4daa-93f7-93f305fa6eb4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:01.629442 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1094f94f-e065-4daa-93f7-93f305fa6eb4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:01.630186 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1094f94f-e065-4daa-93f7-93f305fa6eb4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:01.630654 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1094f94f-e065-4daa-93f7-93f305fa6eb4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:01.698690 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1560691e-9eca-495a-adba-139fa3600997 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:01.699277 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1560691e-9eca-495a-adba-139fa3600997 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:01.705439 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1560691e-9eca-495a-adba-139fa3600997 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:01.707264 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1560691e-9eca-495a-adba-139fa3600997 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:01.707264 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1560691e-9eca-495a-adba-139fa3600997 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:01.707264 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1560691e-9eca-495a-adba-139fa3600997 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:01.763355 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1094f94f-e065-4daa-93f7-93f305fa6eb4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:01.770785 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1094f94f-e065-4daa-93f7-93f305fa6eb4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.152549 Jun 07 13:15:01.771361 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 119/254] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:01 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:01.841893 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1560691e-9eca-495a-adba-139fa3600997 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:01.850244 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1560691e-9eca-495a-adba-139fa3600997 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.155398 Jun 07 13:15:01.851067 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 136/255] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:01 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:02.012135 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-4ef90544-9965-48a2-8c72-de2c75befa38 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:02.012736 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-4ef90544-9965-48a2-8c72-de2c75befa38 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:02.019311 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4ef90544-9965-48a2-8c72-de2c75befa38 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:02.019752 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4ef90544-9965-48a2-8c72-de2c75befa38 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:02.020496 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4ef90544-9965-48a2-8c72-de2c75befa38 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:02.020921 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4ef90544-9965-48a2-8c72-de2c75befa38 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:02.147471 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-4ef90544-9965-48a2-8c72-de2c75befa38 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:02.154676 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-4ef90544-9965-48a2-8c72-de2c75befa38 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.146324 Jun 07 13:15:02.155237 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 120/256] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:02 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:02.217298 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3c700f1f-1a13-4f22-8f9f-9def3e3f2aff tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:02.217911 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3c700f1f-1a13-4f22-8f9f-9def3e3f2aff tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:02.224496 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c700f1f-1a13-4f22-8f9f-9def3e3f2aff tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:02.224942 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c700f1f-1a13-4f22-8f9f-9def3e3f2aff tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:02.225700 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c700f1f-1a13-4f22-8f9f-9def3e3f2aff tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:02.226135 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c700f1f-1a13-4f22-8f9f-9def3e3f2aff tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:02.338781 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-37770ac6-1afb-4acb-86ff-2320124165eb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:02.339382 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-37770ac6-1afb-4acb-86ff-2320124165eb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:02.346554 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-37770ac6-1afb-4acb-86ff-2320124165eb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:02.347007 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-37770ac6-1afb-4acb-86ff-2320124165eb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:02.347779 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-37770ac6-1afb-4acb-86ff-2320124165eb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:02.348225 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-37770ac6-1afb-4acb-86ff-2320124165eb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:02.351168 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3c700f1f-1a13-4f22-8f9f-9def3e3f2aff tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:02.353406 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:02.359655 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3c700f1f-1a13-4f22-8f9f-9def3e3f2aff tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.146290 Jun 07 13:15:02.360215 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 137/257] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:02 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:02.475271 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-37770ac6-1afb-4acb-86ff-2320124165eb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:02.482990 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-37770ac6-1afb-4acb-86ff-2320124165eb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:02.484509 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-37770ac6-1afb-4acb-86ff-2320124165eb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:02.485596 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-37770ac6-1afb-4acb-86ff-2320124165eb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.150799 Jun 07 13:15:02.486160 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 121/258] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:02 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:15:02.787511 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5dd8f84c-bb79-4c14-b9b5-bd1f1505c503 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:02.788121 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5dd8f84c-bb79-4c14-b9b5-bd1f1505c503 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:02.794638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5dd8f84c-bb79-4c14-b9b5-bd1f1505c503 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:02.795092 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5dd8f84c-bb79-4c14-b9b5-bd1f1505c503 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:02.795855 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5dd8f84c-bb79-4c14-b9b5-bd1f1505c503 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:02.796288 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5dd8f84c-bb79-4c14-b9b5-bd1f1505c503 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:02.867003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-331cba27-528e-4535-88f6-7a52ebca874f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:02.867788 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-331cba27-528e-4535-88f6-7a52ebca874f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:02.874467 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-331cba27-528e-4535-88f6-7a52ebca874f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:02.875013 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-331cba27-528e-4535-88f6-7a52ebca874f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:02.876659 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-331cba27-528e-4535-88f6-7a52ebca874f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:02.877112 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-331cba27-528e-4535-88f6-7a52ebca874f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:02.961380 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5dd8f84c-bb79-4c14-b9b5-bd1f1505c503 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:02.970357 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5dd8f84c-bb79-4c14-b9b5-bd1f1505c503 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.186787 Jun 07 13:15:02.978040 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 138/259] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:02 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:03.009191 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-331cba27-528e-4535-88f6-7a52ebca874f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:03.016602 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-331cba27-528e-4535-88f6-7a52ebca874f tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.153677 Jun 07 13:15:03.017156 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 122/260] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:02 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:03.172509 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f3cd409c-6934-4894-ab72-da45360d3811 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:03.173118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f3cd409c-6934-4894-ab72-da45360d3811 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:03.179063 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f3cd409c-6934-4894-ab72-da45360d3811 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:03.179509 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f3cd409c-6934-4894-ab72-da45360d3811 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:03.180311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f3cd409c-6934-4894-ab72-da45360d3811 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:03.180692 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f3cd409c-6934-4894-ab72-da45360d3811 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:03.303498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f3cd409c-6934-4894-ab72-da45360d3811 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:03.311478 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f3cd409c-6934-4894-ab72-da45360d3811 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.143304 Jun 07 13:15:03.312079 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 139/261] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:03 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:03.376531 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-049b60a3-ee70-475c-814a-72858fabe4fb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:03.377138 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-049b60a3-ee70-475c-814a-72858fabe4fb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:03.383131 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-049b60a3-ee70-475c-814a-72858fabe4fb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:03.383578 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-049b60a3-ee70-475c-814a-72858fabe4fb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:03.384336 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-049b60a3-ee70-475c-814a-72858fabe4fb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:03.384773 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-049b60a3-ee70-475c-814a-72858fabe4fb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:03.503636 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d3bdad3b-2ca9-4b2d-a7f2-301a6f306f2d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:03.504266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d3bdad3b-2ca9-4b2d-a7f2-301a6f306f2d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:03.511248 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d3bdad3b-2ca9-4b2d-a7f2-301a6f306f2d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:03.511762 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d3bdad3b-2ca9-4b2d-a7f2-301a6f306f2d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:03.512809 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d3bdad3b-2ca9-4b2d-a7f2-301a6f306f2d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:03.513298 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d3bdad3b-2ca9-4b2d-a7f2-301a6f306f2d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:03.517046 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-049b60a3-ee70-475c-814a-72858fabe4fb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:03.526948 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-049b60a3-ee70-475c-814a-72858fabe4fb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.154126 Jun 07 13:15:03.528203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 123/262] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:03 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:03.643974 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d3bdad3b-2ca9-4b2d-a7f2-301a6f306f2d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:03.651822 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d3bdad3b-2ca9-4b2d-a7f2-301a6f306f2d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:03.653351 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d3bdad3b-2ca9-4b2d-a7f2-301a6f306f2d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:03.654431 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d3bdad3b-2ca9-4b2d-a7f2-301a6f306f2d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.154983 Jun 07 13:15:03.655004 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 140/263] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:03 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:15:03.986581 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-6e007826-2268-4041-ab3a-f32855111149 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:03.987219 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-6e007826-2268-4041-ab3a-f32855111149 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:03.993274 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6e007826-2268-4041-ab3a-f32855111149 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:03.993718 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6e007826-2268-4041-ab3a-f32855111149 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:03.994499 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6e007826-2268-4041-ab3a-f32855111149 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:03.994932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6e007826-2268-4041-ab3a-f32855111149 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:04.036966 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-53e699be-ec5b-4378-8361-160d71f853a1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:04.037785 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-53e699be-ec5b-4378-8361-160d71f853a1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:04.044904 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53e699be-ec5b-4378-8361-160d71f853a1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:04.045360 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53e699be-ec5b-4378-8361-160d71f853a1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:04.046588 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53e699be-ec5b-4378-8361-160d71f853a1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:04.047087 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53e699be-ec5b-4378-8361-160d71f853a1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:04.128897 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-6e007826-2268-4041-ab3a-f32855111149 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:04.136502 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-6e007826-2268-4041-ab3a-f32855111149 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.153824 Jun 07 13:15:04.137079 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 124/264] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:03 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:04.178602 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-53e699be-ec5b-4378-8361-160d71f853a1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:04.186011 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-53e699be-ec5b-4378-8361-160d71f853a1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.156641 Jun 07 13:15:04.186615 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 141/265] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:04 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:04.331004 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-34b1cd1f-ffea-4a2a-a9a0-f3a9efa0ff56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:04.332010 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-34b1cd1f-ffea-4a2a-a9a0-f3a9efa0ff56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:04.339036 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-34b1cd1f-ffea-4a2a-a9a0-f3a9efa0ff56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:04.339491 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-34b1cd1f-ffea-4a2a-a9a0-f3a9efa0ff56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:04.340253 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-34b1cd1f-ffea-4a2a-a9a0-f3a9efa0ff56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:04.340689 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-34b1cd1f-ffea-4a2a-a9a0-f3a9efa0ff56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:04.464331 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-34b1cd1f-ffea-4a2a-a9a0-f3a9efa0ff56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:04.471681 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-34b1cd1f-ffea-4a2a-a9a0-f3a9efa0ff56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.147523 Jun 07 13:15:04.472249 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 125/266] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:04 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:04.544831 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-420d5a93-fa76-49f0-8af6-6dbd988e24cf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:04.545462 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-420d5a93-fa76-49f0-8af6-6dbd988e24cf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:04.551894 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-420d5a93-fa76-49f0-8af6-6dbd988e24cf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:04.552336 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-420d5a93-fa76-49f0-8af6-6dbd988e24cf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:04.553083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-420d5a93-fa76-49f0-8af6-6dbd988e24cf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:04.553512 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-420d5a93-fa76-49f0-8af6-6dbd988e24cf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:04.673834 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-cde6f880-6f90-45bc-919e-79800d0fc33a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:04.674638 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-cde6f880-6f90-45bc-919e-79800d0fc33a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:04.679173 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-420d5a93-fa76-49f0-8af6-6dbd988e24cf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:04.681027 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cde6f880-6f90-45bc-919e-79800d0fc33a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:04.681479 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cde6f880-6f90-45bc-919e-79800d0fc33a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:04.682252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cde6f880-6f90-45bc-919e-79800d0fc33a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:04.682713 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cde6f880-6f90-45bc-919e-79800d0fc33a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:04.686688 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-420d5a93-fa76-49f0-8af6-6dbd988e24cf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.145609 Jun 07 13:15:04.687254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 142/267] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:04 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:04.818228 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cde6f880-6f90-45bc-919e-79800d0fc33a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:04.829255 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cde6f880-6f90-45bc-919e-79800d0fc33a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:04.830763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cde6f880-6f90-45bc-919e-79800d0fc33a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:04.831868 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-cde6f880-6f90-45bc-919e-79800d0fc33a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.162620 Jun 07 13:15:04.832631 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 126/268] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:04 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:15:05.153367 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-19a58809-bc48-48ee-b4da-b9121e1ebd36 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:05.153970 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-19a58809-bc48-48ee-b4da-b9121e1ebd36 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:05.160577 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-19a58809-bc48-48ee-b4da-b9121e1ebd36 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:05.161012 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-19a58809-bc48-48ee-b4da-b9121e1ebd36 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:05.162020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-19a58809-bc48-48ee-b4da-b9121e1ebd36 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:05.162464 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-19a58809-bc48-48ee-b4da-b9121e1ebd36 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:05.202951 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ef218e98-dd38-41bd-88e0-2031eb6efd26 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:05.203557 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ef218e98-dd38-41bd-88e0-2031eb6efd26 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:05.210076 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ef218e98-dd38-41bd-88e0-2031eb6efd26 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:05.210550 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ef218e98-dd38-41bd-88e0-2031eb6efd26 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:05.211305 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ef218e98-dd38-41bd-88e0-2031eb6efd26 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:05.211732 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ef218e98-dd38-41bd-88e0-2031eb6efd26 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:05.313628 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-19a58809-bc48-48ee-b4da-b9121e1ebd36 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:05.323305 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-19a58809-bc48-48ee-b4da-b9121e1ebd36 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.173620 Jun 07 13:15:05.332668 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 143/269] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:05 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:05.360103 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ef218e98-dd38-41bd-88e0-2031eb6efd26 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:05.367777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ef218e98-dd38-41bd-88e0-2031eb6efd26 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.168521 Jun 07 13:15:05.368342 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 127/270] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:05 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:05.488408 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b1dc53c4-980c-4a0c-af67-144ff094ce56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:05.489149 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b1dc53c4-980c-4a0c-af67-144ff094ce56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:05.495669 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b1dc53c4-980c-4a0c-af67-144ff094ce56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:05.496111 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b1dc53c4-980c-4a0c-af67-144ff094ce56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:05.496871 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b1dc53c4-980c-4a0c-af67-144ff094ce56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:05.497295 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b1dc53c4-980c-4a0c-af67-144ff094ce56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:05.623794 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b1dc53c4-980c-4a0c-af67-144ff094ce56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:05.631655 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b1dc53c4-980c-4a0c-af67-144ff094ce56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.147727 Jun 07 13:15:05.632253 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 144/271] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:05 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:05.704749 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-2b888f2d-6444-4f07-b471-8daa96451520 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:05.705423 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-2b888f2d-6444-4f07-b471-8daa96451520 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:05.711475 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2b888f2d-6444-4f07-b471-8daa96451520 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:05.711925 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2b888f2d-6444-4f07-b471-8daa96451520 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:05.712684 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2b888f2d-6444-4f07-b471-8daa96451520 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:05.713121 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2b888f2d-6444-4f07-b471-8daa96451520 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:05.843910 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-2b888f2d-6444-4f07-b471-8daa96451520 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:05.849719 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5f565758-242c-405e-8334-7bb05ea9d64d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:05.850829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5f565758-242c-405e-8334-7bb05ea9d64d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:05.852133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-2b888f2d-6444-4f07-b471-8daa96451520 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.151831 Jun 07 13:15:05.857733 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5f565758-242c-405e-8334-7bb05ea9d64d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:05.858410 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5f565758-242c-405e-8334-7bb05ea9d64d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:05.859372 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5f565758-242c-405e-8334-7bb05ea9d64d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:05.860054 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5f565758-242c-405e-8334-7bb05ea9d64d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:05.862847 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 128/272] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:05 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:05.995221 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5f565758-242c-405e-8334-7bb05ea9d64d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:06.003748 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5f565758-242c-405e-8334-7bb05ea9d64d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:06.005363 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5f565758-242c-405e-8334-7bb05ea9d64d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:06.006509 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5f565758-242c-405e-8334-7bb05ea9d64d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.161278 Jun 07 13:15:06.007061 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 145/273] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:05 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:06.341132 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e2a1771d-2751-4ea8-9f3a-82f597beed11 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:06.341732 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-e2a1771d-2751-4ea8-9f3a-82f597beed11 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:06.348201 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e2a1771d-2751-4ea8-9f3a-82f597beed11 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:06.348641 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e2a1771d-2751-4ea8-9f3a-82f597beed11 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:06.349387 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e2a1771d-2751-4ea8-9f3a-82f597beed11 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:06.349813 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e2a1771d-2751-4ea8-9f3a-82f597beed11 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:06.364786 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:06.384773 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e1266340-f5e0-4c01-97ff-b4fa916ee40a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:06.385391 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e1266340-f5e0-4c01-97ff-b4fa916ee40a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:06.391425 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e1266340-f5e0-4c01-97ff-b4fa916ee40a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:06.391876 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e1266340-f5e0-4c01-97ff-b4fa916ee40a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:06.392637 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e1266340-f5e0-4c01-97ff-b4fa916ee40a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:06.393068 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e1266340-f5e0-4c01-97ff-b4fa916ee40a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:06.475247 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e2a1771d-2751-4ea8-9f3a-82f597beed11 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:06.482646 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e2a1771d-2751-4ea8-9f3a-82f597beed11 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.145328 Jun 07 13:15:06.483210 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 129/274] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:06 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:06.526788 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e1266340-f5e0-4c01-97ff-b4fa916ee40a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:06.534853 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e1266340-f5e0-4c01-97ff-b4fa916ee40a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.153894 Jun 07 13:15:06.535418 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 146/275] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:06 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:06.648489 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-538ab2c5-7684-4447-881b-ef0a415f29e0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:06.649099 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-538ab2c5-7684-4447-881b-ef0a415f29e0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:06.655335 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-538ab2c5-7684-4447-881b-ef0a415f29e0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:06.655784 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-538ab2c5-7684-4447-881b-ef0a415f29e0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:06.656572 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-538ab2c5-7684-4447-881b-ef0a415f29e0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:06.657010 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-538ab2c5-7684-4447-881b-ef0a415f29e0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:06.778313 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-538ab2c5-7684-4447-881b-ef0a415f29e0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:06.786545 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-538ab2c5-7684-4447-881b-ef0a415f29e0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.141574 Jun 07 13:15:06.787104 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 130/276] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:06 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:06.869072 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-45821707-33ed-4684-9403-fba6782da119 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:06.869679 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-45821707-33ed-4684-9403-fba6782da119 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:06.876477 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-45821707-33ed-4684-9403-fba6782da119 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:06.880725 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-45821707-33ed-4684-9403-fba6782da119 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:06.880725 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-45821707-33ed-4684-9403-fba6782da119 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:06.880725 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-45821707-33ed-4684-9403-fba6782da119 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:07.015664 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-45821707-33ed-4684-9403-fba6782da119 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:07.024177 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-aed49112-7316-4aa6-8eca-277c1a6942f7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:07.024784 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-aed49112-7316-4aa6-8eca-277c1a6942f7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:07.031015 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-aed49112-7316-4aa6-8eca-277c1a6942f7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:07.031548 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-aed49112-7316-4aa6-8eca-277c1a6942f7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:07.032426 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-aed49112-7316-4aa6-8eca-277c1a6942f7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:07.032966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-aed49112-7316-4aa6-8eca-277c1a6942f7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:07.033117 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-45821707-33ed-4684-9403-fba6782da119 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.167789 Jun 07 13:15:07.042484 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 147/277] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:06 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:07.165638 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-aed49112-7316-4aa6-8eca-277c1a6942f7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:07.176287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-aed49112-7316-4aa6-8eca-277c1a6942f7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:07.177824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-aed49112-7316-4aa6-8eca-277c1a6942f7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:07.179306 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-aed49112-7316-4aa6-8eca-277c1a6942f7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.158745 Jun 07 13:15:07.179907 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 131/278] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:07 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:07.500199 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8d57fa20-6e7e-4289-9b0a-cf0c4dc7657c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:07.500718 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8d57fa20-6e7e-4289-9b0a-cf0c4dc7657c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:07.506715 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8d57fa20-6e7e-4289-9b0a-cf0c4dc7657c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:07.507160 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8d57fa20-6e7e-4289-9b0a-cf0c4dc7657c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:07.507944 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8d57fa20-6e7e-4289-9b0a-cf0c4dc7657c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:07.508378 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8d57fa20-6e7e-4289-9b0a-cf0c4dc7657c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:07.551689 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3e287389-eb35-4a31-ad6c-500a2bca1edc tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:07.552412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3e287389-eb35-4a31-ad6c-500a2bca1edc tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:07.558275 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3e287389-eb35-4a31-ad6c-500a2bca1edc tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:07.558769 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3e287389-eb35-4a31-ad6c-500a2bca1edc tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:07.559532 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3e287389-eb35-4a31-ad6c-500a2bca1edc tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:07.559967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3e287389-eb35-4a31-ad6c-500a2bca1edc tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:07.638286 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8d57fa20-6e7e-4289-9b0a-cf0c4dc7657c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:07.646557 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8d57fa20-6e7e-4289-9b0a-cf0c4dc7657c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.150177 Jun 07 13:15:07.647125 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 148/279] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:07 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:07.686328 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3e287389-eb35-4a31-ad6c-500a2bca1edc tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:07.694161 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3e287389-eb35-4a31-ad6c-500a2bca1edc tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.146353 Jun 07 13:15:07.694747 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 132/280] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:07 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:07.802952 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c20eab12-ac2e-4274-854e-fa3ca6df415b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:07.803487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c20eab12-ac2e-4274-854e-fa3ca6df415b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:07.809410 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c20eab12-ac2e-4274-854e-fa3ca6df415b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:07.809848 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c20eab12-ac2e-4274-854e-fa3ca6df415b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:07.810622 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c20eab12-ac2e-4274-854e-fa3ca6df415b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:07.811048 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c20eab12-ac2e-4274-854e-fa3ca6df415b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:07.934620 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c20eab12-ac2e-4274-854e-fa3ca6df415b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:07.942340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c20eab12-ac2e-4274-854e-fa3ca6df415b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.143301 Jun 07 13:15:07.943012 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 149/281] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:07 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:08.049443 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-dde0df84-0b15-49a3-911d-342d32209b9b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:08.050047 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-dde0df84-0b15-49a3-911d-342d32209b9b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:08.055989 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dde0df84-0b15-49a3-911d-342d32209b9b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:08.056378 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dde0df84-0b15-49a3-911d-342d32209b9b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:08.057136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dde0df84-0b15-49a3-911d-342d32209b9b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:08.057568 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dde0df84-0b15-49a3-911d-342d32209b9b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:08.185620 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-dde0df84-0b15-49a3-911d-342d32209b9b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:08.193660 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-dde0df84-0b15-49a3-911d-342d32209b9b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.148489 Jun 07 13:15:08.194214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 133/282] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:08 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:08.197393 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b3c01631-d7ec-419e-b56a-1854deab01ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:08.198011 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b3c01631-d7ec-419e-b56a-1854deab01ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:08.203843 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b3c01631-d7ec-419e-b56a-1854deab01ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:08.204287 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b3c01631-d7ec-419e-b56a-1854deab01ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:08.205048 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b3c01631-d7ec-419e-b56a-1854deab01ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:08.205481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b3c01631-d7ec-419e-b56a-1854deab01ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:08.334291 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b3c01631-d7ec-419e-b56a-1854deab01ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:08.342149 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b3c01631-d7ec-419e-b56a-1854deab01ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:08.343694 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b3c01631-d7ec-419e-b56a-1854deab01ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:08.344787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b3c01631-d7ec-419e-b56a-1854deab01ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.151225 Jun 07 13:15:08.345342 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 150/283] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:08 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:15:08.663764 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ce8c010d-fad1-41dd-b226-af82455df84d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:08.664394 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ce8c010d-fad1-41dd-b226-af82455df84d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:08.670245 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce8c010d-fad1-41dd-b226-af82455df84d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:08.670717 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce8c010d-fad1-41dd-b226-af82455df84d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:08.671462 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce8c010d-fad1-41dd-b226-af82455df84d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:08.671888 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce8c010d-fad1-41dd-b226-af82455df84d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:08.710647 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-531d41df-9d4d-4bed-a695-8bbdce9c2687 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:08.711246 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-531d41df-9d4d-4bed-a695-8bbdce9c2687 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:08.717571 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-531d41df-9d4d-4bed-a695-8bbdce9c2687 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:08.718018 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-531d41df-9d4d-4bed-a695-8bbdce9c2687 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:08.718815 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-531d41df-9d4d-4bed-a695-8bbdce9c2687 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:08.719245 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-531d41df-9d4d-4bed-a695-8bbdce9c2687 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:08.797213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ce8c010d-fad1-41dd-b226-af82455df84d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:08.804641 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ce8c010d-fad1-41dd-b226-af82455df84d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.144876 Jun 07 13:15:08.805214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 134/284] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:08 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:08.847286 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-531d41df-9d4d-4bed-a695-8bbdce9c2687 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:08.854555 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-531d41df-9d4d-4bed-a695-8bbdce9c2687 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1315 microversion: 2.1 time: 0.147659 Jun 07 13:15:08.855120 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 151/285] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:08 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:08.958664 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-da3ef991-5acd-4fe1-9931-733d9b4a1eb1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:08.959265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-da3ef991-5acd-4fe1-9931-733d9b4a1eb1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:08.965302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-da3ef991-5acd-4fe1-9931-733d9b4a1eb1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:08.965788 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-da3ef991-5acd-4fe1-9931-733d9b4a1eb1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:08.966584 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-da3ef991-5acd-4fe1-9931-733d9b4a1eb1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:08.967021 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-da3ef991-5acd-4fe1-9931-733d9b4a1eb1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:09.095523 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-da3ef991-5acd-4fe1-9931-733d9b4a1eb1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:09.102794 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-da3ef991-5acd-4fe1-9931-733d9b4a1eb1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.147795 Jun 07 13:15:09.103352 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 135/286] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:08 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:09.210843 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3edd0a72-a97e-4cce-9e6f-9f45c4ca17fe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:09.211442 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3edd0a72-a97e-4cce-9e6f-9f45c4ca17fe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:09.217370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3edd0a72-a97e-4cce-9e6f-9f45c4ca17fe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:09.217811 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3edd0a72-a97e-4cce-9e6f-9f45c4ca17fe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:09.218639 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3edd0a72-a97e-4cce-9e6f-9f45c4ca17fe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:09.219065 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3edd0a72-a97e-4cce-9e6f-9f45c4ca17fe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:09.346678 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3edd0a72-a97e-4cce-9e6f-9f45c4ca17fe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:09.353911 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3edd0a72-a97e-4cce-9e6f-9f45c4ca17fe tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.146904 Jun 07 13:15:09.354491 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 152/287] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:09 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:09.365035 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ed162c08-7d29-4bff-b83a-c0c4f4916728 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:09.365637 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ed162c08-7d29-4bff-b83a-c0c4f4916728 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:09.371700 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ed162c08-7d29-4bff-b83a-c0c4f4916728 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:09.372146 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ed162c08-7d29-4bff-b83a-c0c4f4916728 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:09.372901 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ed162c08-7d29-4bff-b83a-c0c4f4916728 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:09.373349 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ed162c08-7d29-4bff-b83a-c0c4f4916728 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:09.507694 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ed162c08-7d29-4bff-b83a-c0c4f4916728 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:09.515814 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ed162c08-7d29-4bff-b83a-c0c4f4916728 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:09.517301 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ed162c08-7d29-4bff-b83a-c0c4f4916728 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:09.518394 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ed162c08-7d29-4bff-b83a-c0c4f4916728 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.157322 Jun 07 13:15:09.528998 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 136/288] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:09 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:09.822738 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0321b290-8913-4b9d-8e8c-504e710e8706 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:09.824270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0321b290-8913-4b9d-8e8c-504e710e8706 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:09.833743 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0321b290-8913-4b9d-8e8c-504e710e8706 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:09.834617 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0321b290-8913-4b9d-8e8c-504e710e8706 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:09.844914 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0321b290-8913-4b9d-8e8c-504e710e8706 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:09.847020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0321b290-8913-4b9d-8e8c-504e710e8706 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:09.872032 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-512437e6-33dc-43a7-922a-630a2a8576cc tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:09.873526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-512437e6-33dc-43a7-922a-630a2a8576cc tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:09.880769 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-512437e6-33dc-43a7-922a-630a2a8576cc tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:09.881299 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-512437e6-33dc-43a7-922a-630a2a8576cc tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:09.882072 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-512437e6-33dc-43a7-922a-630a2a8576cc tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:09.884636 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-512437e6-33dc-43a7-922a-630a2a8576cc tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:10.048994 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-512437e6-33dc-43a7-922a-630a2a8576cc tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:10.062315 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-512437e6-33dc-43a7-922a-630a2a8576cc tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1502 microversion: 2.1 time: 0.192467 Jun 07 13:15:10.075444 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 137/289] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:09 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1502 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:10.097958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0321b290-8913-4b9d-8e8c-504e710e8706 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:10.113920 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0321b290-8913-4b9d-8e8c-504e710e8706 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.295817 Jun 07 13:15:10.123823 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 153/290] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:09 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:10.123940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-2e7e1598-9253-4505-baed-b80e6773a5e9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:10.124363 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-2e7e1598-9253-4505-baed-b80e6773a5e9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:10.133111 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2e7e1598-9253-4505-baed-b80e6773a5e9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:10.133748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2e7e1598-9253-4505-baed-b80e6773a5e9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:10.134758 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2e7e1598-9253-4505-baed-b80e6773a5e9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:10.135307 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2e7e1598-9253-4505-baed-b80e6773a5e9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:10.314078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-2e7e1598-9253-4505-baed-b80e6773a5e9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:10.323844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-2e7e1598-9253-4505-baed-b80e6773a5e9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.204866 Jun 07 13:15:10.332329 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 138/291] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:10 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:10.370729 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0b06a805-7c29-454e-aa98-4a0386d15dc2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:10.371668 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0b06a805-7c29-454e-aa98-4a0386d15dc2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:10.381511 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0b06a805-7c29-454e-aa98-4a0386d15dc2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:10.383147 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0b06a805-7c29-454e-aa98-4a0386d15dc2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:10.385726 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0b06a805-7c29-454e-aa98-4a0386d15dc2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:10.387495 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0b06a805-7c29-454e-aa98-4a0386d15dc2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:10.431792 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:10.541429 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-82e1de3e-d6e4-4569-8e41-943888d51a7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:10.542158 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-82e1de3e-d6e4-4569-8e41-943888d51a7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:10.554752 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-82e1de3e-d6e4-4569-8e41-943888d51a7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:10.555338 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-82e1de3e-d6e4-4569-8e41-943888d51a7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:10.556156 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-82e1de3e-d6e4-4569-8e41-943888d51a7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:10.556632 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-82e1de3e-d6e4-4569-8e41-943888d51a7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:10.703495 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0b06a805-7c29-454e-aa98-4a0386d15dc2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:10.717073 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0b06a805-7c29-454e-aa98-4a0386d15dc2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.350106 Jun 07 13:15:10.718262 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 154/292] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:10 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:10.726375 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-10cb3f1d-2f63-4734-af0b-afa034ecec5e req-726ca10d-8d30-4395-a597-08c570996811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64eec94b-9fac-4ad4-8386-01a27db4d5ce", "tag": "689501bc-bf08-4b3c-8c94-bc415ab172a1"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:15:10.739185 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-10cb3f1d-2f63-4734-af0b-afa034ecec5e req-726ca10d-8d30-4395-a597-08c570996811 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:10.739897 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-10cb3f1d-2f63-4734-af0b-afa034ecec5e req-726ca10d-8d30-4395-a597-08c570996811 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:10.756047 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-10cb3f1d-2f63-4734-af0b-afa034ecec5e req-726ca10d-8d30-4395-a597-08c570996811 service nova] Creating event network-changed:689501bc-bf08-4b3c-8c94-bc415ab172a1 for instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce on hv-cinder-84496 Jun 07 13:15:10.761761 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-10cb3f1d-2f63-4734-af0b-afa034ecec5e req-726ca10d-8d30-4395-a597-08c570996811 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041736 Jun 07 13:15:10.762581 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 155/293] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:15:10.810644 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-82e1de3e-d6e4-4569-8e41-943888d51a7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:10.820691 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-82e1de3e-d6e4-4569-8e41-943888d51a7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:10.822505 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-82e1de3e-d6e4-4569-8e41-943888d51a7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:10.823969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-82e1de3e-d6e4-4569-8e41-943888d51a7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.286573 Jun 07 13:15:10.825276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 139/294] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:10 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:11.131084 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-66d05021-35db-429f-bb43-2dda8f202ca6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:11.131782 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-66d05021-35db-429f-bb43-2dda8f202ca6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:11.137928 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-66d05021-35db-429f-bb43-2dda8f202ca6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:11.138403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-66d05021-35db-429f-bb43-2dda8f202ca6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:11.139197 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-66d05021-35db-429f-bb43-2dda8f202ca6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:11.139629 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-66d05021-35db-429f-bb43-2dda8f202ca6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:11.268265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-66d05021-35db-429f-bb43-2dda8f202ca6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:11.276118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-66d05021-35db-429f-bb43-2dda8f202ca6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.148906 Jun 07 13:15:11.276763 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 156/295] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:11 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:11.343322 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1a342d26-589e-4a55-a78b-471c45c637cb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:11.343322 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1a342d26-589e-4a55-a78b-471c45c637cb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:11.351799 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1a342d26-589e-4a55-a78b-471c45c637cb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:11.352240 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1a342d26-589e-4a55-a78b-471c45c637cb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:11.353127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1a342d26-589e-4a55-a78b-471c45c637cb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:11.353566 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1a342d26-589e-4a55-a78b-471c45c637cb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:11.396421 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-71fd17d0-2843-494c-a33a-d51016f0875d req-42b41566-fe0c-4a6a-aec3-04c91ad16b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec72c48-4900-4d75-8fca-c5b6f5a287ca", "name": "network-vif-plugged", "status": "completed", "tag": "58128dcd-c6cf-4bd6-852b-7f5930478fbf"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:15:11.407934 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-71fd17d0-2843-494c-a33a-d51016f0875d req-42b41566-fe0c-4a6a-aec3-04c91ad16b14 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:11.408438 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-71fd17d0-2843-494c-a33a-d51016f0875d req-42b41566-fe0c-4a6a-aec3-04c91ad16b14 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:11.421113 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-71fd17d0-2843-494c-a33a-d51016f0875d req-42b41566-fe0c-4a6a-aec3-04c91ad16b14 service nova] Creating event network-vif-plugged:58128dcd-c6cf-4bd6-852b-7f5930478fbf for instance dec72c48-4900-4d75-8fca-c5b6f5a287ca on hv-cinder-84496 Jun 07 13:15:11.426204 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-71fd17d0-2843-494c-a33a-d51016f0875d req-42b41566-fe0c-4a6a-aec3-04c91ad16b14 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034605 Jun 07 13:15:11.426840 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 157/296] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:15:11.515834 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1a342d26-589e-4a55-a78b-471c45c637cb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:11.524153 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1a342d26-589e-4a55-a78b-471c45c637cb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.186899 Jun 07 13:15:11.524731 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 140/297] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:11 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:11.676133 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e8e8100c-9019-4a88-8b02-f714687fd2d7 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdde6c54-37fe-49ef-9231-82fe3d86eb6f"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:15:11.677281 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e8e8100c-9019-4a88-8b02-f714687fd2d7 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:11.683423 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e8e8100c-9019-4a88-8b02-f714687fd2d7 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:11.683865 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e8e8100c-9019-4a88-8b02-f714687fd2d7 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:11.684628 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e8e8100c-9019-4a88-8b02-f714687fd2d7 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:11.685057 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e8e8100c-9019-4a88-8b02-f714687fd2d7 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:11.736248 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5cdbd32c-31f2-4689-bd04-590c18971814 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:11.737136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5cdbd32c-31f2-4689-bd04-590c18971814 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:11.743730 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5cdbd32c-31f2-4689-bd04-590c18971814 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:11.745216 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5cdbd32c-31f2-4689-bd04-590c18971814 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:11.746020 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5cdbd32c-31f2-4689-bd04-590c18971814 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:11.746586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5cdbd32c-31f2-4689-bd04-590c18971814 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:11.889229 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5cdbd32c-31f2-4689-bd04-590c18971814 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:11.897058 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5cdbd32c-31f2-4689-bd04-590c18971814 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.165273 Jun 07 13:15:11.897649 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 141/298] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:11 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:11.902236 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e8da442e-3598-4cca-9ed4-7a223f5d9f32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:11.902865 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-e8da442e-3598-4cca-9ed4-7a223f5d9f32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:11.908683 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e8da442e-3598-4cca-9ed4-7a223f5d9f32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:11.909133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e8da442e-3598-4cca-9ed4-7a223f5d9f32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:11.909907 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e8da442e-3598-4cca-9ed4-7a223f5d9f32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:11.910342 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e8da442e-3598-4cca-9ed4-7a223f5d9f32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:12.056811 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e8da442e-3598-4cca-9ed4-7a223f5d9f32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:12.065341 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e8da442e-3598-4cca-9ed4-7a223f5d9f32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:12.066857 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e8da442e-3598-4cca-9ed4-7a223f5d9f32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:12.067931 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e8da442e-3598-4cca-9ed4-7a223f5d9f32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.169378 Jun 07 13:15:12.068475 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 142/299] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:11 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:12.292755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-4ea28b68-25e9-42be-a5d7-03db3c7b05f3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:12.293358 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-4ea28b68-25e9-42be-a5d7-03db3c7b05f3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:12.299982 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4ea28b68-25e9-42be-a5d7-03db3c7b05f3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:12.300428 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4ea28b68-25e9-42be-a5d7-03db3c7b05f3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:12.301185 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4ea28b68-25e9-42be-a5d7-03db3c7b05f3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:12.301617 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4ea28b68-25e9-42be-a5d7-03db3c7b05f3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:12.434092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-4ea28b68-25e9-42be-a5d7-03db3c7b05f3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:12.441438 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-4ea28b68-25e9-42be-a5d7-03db3c7b05f3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.152452 Jun 07 13:15:12.442004 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 143/300] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:12 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:12.540053 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9624a993-3db7-443d-ac37-e9db810c7dbc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:12.540657 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9624a993-3db7-443d-ac37-e9db810c7dbc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:12.546518 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9624a993-3db7-443d-ac37-e9db810c7dbc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:12.546971 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9624a993-3db7-443d-ac37-e9db810c7dbc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:12.547729 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9624a993-3db7-443d-ac37-e9db810c7dbc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:12.548163 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9624a993-3db7-443d-ac37-e9db810c7dbc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:12.672296 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9624a993-3db7-443d-ac37-e9db810c7dbc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:12.680072 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9624a993-3db7-443d-ac37-e9db810c7dbc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.144117 Jun 07 13:15:12.680637 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 144/301] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:12 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:12.914230 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-797e216b-4027-4b40-aec7-9ecb4937b075 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:12.915398 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-797e216b-4027-4b40-aec7-9ecb4937b075 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:12.924285 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-797e216b-4027-4b40-aec7-9ecb4937b075 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:12.924285 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-797e216b-4027-4b40-aec7-9ecb4937b075 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:12.924285 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-797e216b-4027-4b40-aec7-9ecb4937b075 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:12.924285 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-797e216b-4027-4b40-aec7-9ecb4937b075 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:13.056033 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-797e216b-4027-4b40-aec7-9ecb4937b075 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:13.063818 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-797e216b-4027-4b40-aec7-9ecb4937b075 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1365 microversion: 2.1 time: 0.153720 Jun 07 13:15:13.064390 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 145/302] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:12 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:13.084616 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-2ea6d9ef-a63a-45a6-949d-a2eb0d3eafc6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:13.085228 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-2ea6d9ef-a63a-45a6-949d-a2eb0d3eafc6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:13.091218 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2ea6d9ef-a63a-45a6-949d-a2eb0d3eafc6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:13.091673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2ea6d9ef-a63a-45a6-949d-a2eb0d3eafc6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:13.092432 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2ea6d9ef-a63a-45a6-949d-a2eb0d3eafc6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:13.092868 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2ea6d9ef-a63a-45a6-949d-a2eb0d3eafc6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:13.105788 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:13.285259 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-2ea6d9ef-a63a-45a6-949d-a2eb0d3eafc6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:13.321986 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-2ea6d9ef-a63a-45a6-949d-a2eb0d3eafc6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:13.325018 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-2ea6d9ef-a63a-45a6-949d-a2eb0d3eafc6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:13.334366 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-2ea6d9ef-a63a-45a6-949d-a2eb0d3eafc6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.253552 Jun 07 13:15:13.334990 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 146/303] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:13 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:15:13.460523 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b1064c83-9fa5-4649-93d7-ece316f49ca4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:13.461146 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b1064c83-9fa5-4649-93d7-ece316f49ca4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:13.476110 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b1064c83-9fa5-4649-93d7-ece316f49ca4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:13.477676 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b1064c83-9fa5-4649-93d7-ece316f49ca4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:13.478681 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b1064c83-9fa5-4649-93d7-ece316f49ca4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:13.479504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b1064c83-9fa5-4649-93d7-ece316f49ca4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:13.621778 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b1064c83-9fa5-4649-93d7-ece316f49ca4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:13.629945 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b1064c83-9fa5-4649-93d7-ece316f49ca4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.176844 Jun 07 13:15:13.630539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 147/304] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:13 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:13.696996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5d85cce4-6ac1-43aa-8ec5-6a9daa945a31 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:13.697602 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5d85cce4-6ac1-43aa-8ec5-6a9daa945a31 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:13.703551 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5d85cce4-6ac1-43aa-8ec5-6a9daa945a31 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:13.704556 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5d85cce4-6ac1-43aa-8ec5-6a9daa945a31 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:13.705313 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5d85cce4-6ac1-43aa-8ec5-6a9daa945a31 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:13.705750 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5d85cce4-6ac1-43aa-8ec5-6a9daa945a31 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:13.837307 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5d85cce4-6ac1-43aa-8ec5-6a9daa945a31 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:13.845035 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5d85cce4-6ac1-43aa-8ec5-6a9daa945a31 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.151838 Jun 07 13:15:13.845602 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 148/305] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:13 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:14.083286 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-670091ab-fa43-4288-aa01-4b5e62a6f48d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:14.083979 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-670091ab-fa43-4288-aa01-4b5e62a6f48d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:14.092584 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-670091ab-fa43-4288-aa01-4b5e62a6f48d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:14.093264 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-670091ab-fa43-4288-aa01-4b5e62a6f48d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:14.094134 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-670091ab-fa43-4288-aa01-4b5e62a6f48d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:14.094669 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-670091ab-fa43-4288-aa01-4b5e62a6f48d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:14.247569 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-670091ab-fa43-4288-aa01-4b5e62a6f48d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:14.259340 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-670091ab-fa43-4288-aa01-4b5e62a6f48d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1554 microversion: 2.1 time: 0.182300 Jun 07 13:15:14.259919 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 149/306] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:14 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:14.276255 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8b944873-167a-49e4-bf4e-5862547936c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:14.276790 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8b944873-167a-49e4-bf4e-5862547936c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:14.283396 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8b944873-167a-49e4-bf4e-5862547936c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:14.283847 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8b944873-167a-49e4-bf4e-5862547936c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:14.284606 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8b944873-167a-49e4-bf4e-5862547936c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:14.285045 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8b944873-167a-49e4-bf4e-5862547936c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:14.429206 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8b944873-167a-49e4-bf4e-5862547936c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156734 Jun 07 13:15:14.429787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 150/307] 10.222.0.58 () {58 vars in 1274 bytes} [Tue Jun 7 13:15:14 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:15:14.445641 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-da5008e7-f5dc-4362-95ef-6e5aa28c5194 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:14.446502 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-da5008e7-f5dc-4362-95ef-6e5aa28c5194 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:14.455781 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-da5008e7-f5dc-4362-95ef-6e5aa28c5194 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:14.456447 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-da5008e7-f5dc-4362-95ef-6e5aa28c5194 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:14.457466 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-da5008e7-f5dc-4362-95ef-6e5aa28c5194 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:14.458128 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-da5008e7-f5dc-4362-95ef-6e5aa28c5194 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:14.774616 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-da5008e7-f5dc-4362-95ef-6e5aa28c5194 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:14.783778 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-da5008e7-f5dc-4362-95ef-6e5aa28c5194 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:14.785943 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-da5008e7-f5dc-4362-95ef-6e5aa28c5194 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:14.787384 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-da5008e7-f5dc-4362-95ef-6e5aa28c5194 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.347913 Jun 07 13:15:14.787957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 151/308] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:14 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:14.800069 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1b7bf60b-8880-42be-a3be-c12a2aabcb0c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:14.800683 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1b7bf60b-8880-42be-a3be-c12a2aabcb0c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:14.807159 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1b7bf60b-8880-42be-a3be-c12a2aabcb0c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:14.807606 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1b7bf60b-8880-42be-a3be-c12a2aabcb0c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:14.808373 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1b7bf60b-8880-42be-a3be-c12a2aabcb0c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:14.808806 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1b7bf60b-8880-42be-a3be-c12a2aabcb0c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:15.323119 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1b7bf60b-8880-42be-a3be-c12a2aabcb0c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:15.333386 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1b7bf60b-8880-42be-a3be-c12a2aabcb0c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.537351 Jun 07 13:15:15.337630 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 152/309] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:14 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:15.346430 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7e1e3c61-9802-4d23-a575-e4261c9094bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:15.347310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7e1e3c61-9802-4d23-a575-e4261c9094bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:15.354184 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7e1e3c61-9802-4d23-a575-e4261c9094bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:15.354960 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7e1e3c61-9802-4d23-a575-e4261c9094bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:15.356700 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7e1e3c61-9802-4d23-a575-e4261c9094bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:15.357391 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7e1e3c61-9802-4d23-a575-e4261c9094bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:15.560296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e8e8100c-9019-4a88-8b02-f714687fd2d7 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "POST /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.888409 Jun 07 13:15:15.561546 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 158/310] 10.222.0.58 () {60 vars in 1322 bytes} [Tue Jun 7 13:15:11 2022] POST /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99/os-volume_attachments => generated 194 bytes in 3891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:15:15.741879 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-7e1e3c61-9802-4d23-a575-e4261c9094bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:15.750398 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-7e1e3c61-9802-4d23-a575-e4261c9094bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.411541 Jun 07 13:15:15.755922 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 153/311] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:15 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:15.809145 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-94728efb-b468-478c-8ddc-1f3eba9f4fa6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:15.810061 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-94728efb-b468-478c-8ddc-1f3eba9f4fa6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:15.820027 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-94728efb-b468-478c-8ddc-1f3eba9f4fa6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:15.820807 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-94728efb-b468-478c-8ddc-1f3eba9f4fa6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:15.821971 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-94728efb-b468-478c-8ddc-1f3eba9f4fa6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:15.822824 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-94728efb-b468-478c-8ddc-1f3eba9f4fa6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:16.010798 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-94728efb-b468-478c-8ddc-1f3eba9f4fa6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:16.020001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-94728efb-b468-478c-8ddc-1f3eba9f4fa6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:16.021981 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-94728efb-b468-478c-8ddc-1f3eba9f4fa6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:16.023523 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-94728efb-b468-478c-8ddc-1f3eba9f4fa6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.221548 Jun 07 13:15:16.024821 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 159/312] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:15 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:16.221003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-4febe9a1-8259-4eee-a7c1-f1b67ea67f7a req-c04fc569-70da-4846-9dec-a5d8bfe111ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0", "tag": "fa01f4c1-c3a7-4d48-95e4-fa07833fc0cc"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:15:16.231666 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-4febe9a1-8259-4eee-a7c1-f1b67ea67f7a req-c04fc569-70da-4846-9dec-a5d8bfe111ee service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:16.232110 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-4febe9a1-8259-4eee-a7c1-f1b67ea67f7a req-c04fc569-70da-4846-9dec-a5d8bfe111ee service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:16.248573 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-4febe9a1-8259-4eee-a7c1-f1b67ea67f7a req-c04fc569-70da-4846-9dec-a5d8bfe111ee service nova] Creating event network-changed:fa01f4c1-c3a7-4d48-95e4-fa07833fc0cc for instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 on hv-cinder-84496 Jun 07 13:15:16.254526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-4febe9a1-8259-4eee-a7c1-f1b67ea67f7a req-c04fc569-70da-4846-9dec-a5d8bfe111ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037542 Jun 07 13:15:16.255625 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 154/313] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:15:16.350087 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8ec2dfb8-f003-44d1-97f6-0ac2661d7d68 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:16.350968 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8ec2dfb8-f003-44d1-97f6-0ac2661d7d68 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:16.357409 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8ec2dfb8-f003-44d1-97f6-0ac2661d7d68 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:16.358086 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8ec2dfb8-f003-44d1-97f6-0ac2661d7d68 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:16.359130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8ec2dfb8-f003-44d1-97f6-0ac2661d7d68 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:16.359563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8ec2dfb8-f003-44d1-97f6-0ac2661d7d68 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:16.534005 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8ec2dfb8-f003-44d1-97f6-0ac2661d7d68 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:16.543204 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8ec2dfb8-f003-44d1-97f6-0ac2661d7d68 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.196725 Jun 07 13:15:16.543839 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 160/314] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:16 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:16.775295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-356cfc08-c1a7-4132-892a-1a0630109924 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:16.777403 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-356cfc08-c1a7-4132-892a-1a0630109924 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:16.784694 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-356cfc08-c1a7-4132-892a-1a0630109924 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:16.785342 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-356cfc08-c1a7-4132-892a-1a0630109924 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:16.786613 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-356cfc08-c1a7-4132-892a-1a0630109924 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:16.787193 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-356cfc08-c1a7-4132-892a-1a0630109924 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:16.942173 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-356cfc08-c1a7-4132-892a-1a0630109924 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:16.960792 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-356cfc08-c1a7-4132-892a-1a0630109924 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.191825 Jun 07 13:15:16.969787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 155/315] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:16 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:17.042166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5cfaada7-b6b6-4edf-a4a9-8a790f13b4fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:17.042998 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5cfaada7-b6b6-4edf-a4a9-8a790f13b4fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:17.051910 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5cfaada7-b6b6-4edf-a4a9-8a790f13b4fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:17.052993 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5cfaada7-b6b6-4edf-a4a9-8a790f13b4fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:17.054018 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5cfaada7-b6b6-4edf-a4a9-8a790f13b4fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:17.055683 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5cfaada7-b6b6-4edf-a4a9-8a790f13b4fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:17.216269 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5cfaada7-b6b6-4edf-a4a9-8a790f13b4fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:17.224833 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5cfaada7-b6b6-4edf-a4a9-8a790f13b4fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:17.226332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5cfaada7-b6b6-4edf-a4a9-8a790f13b4fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:17.227630 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5cfaada7-b6b6-4edf-a4a9-8a790f13b4fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.189565 Jun 07 13:15:17.228361 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 161/316] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:17 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:17.560455 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-2fc35bbf-175f-4fa3-b85a-80b1783906c4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:17.561142 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-2fc35bbf-175f-4fa3-b85a-80b1783906c4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:17.574354 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2fc35bbf-175f-4fa3-b85a-80b1783906c4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:17.575871 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2fc35bbf-175f-4fa3-b85a-80b1783906c4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:17.576725 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2fc35bbf-175f-4fa3-b85a-80b1783906c4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:17.577101 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2fc35bbf-175f-4fa3-b85a-80b1783906c4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:17.746252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-2fc35bbf-175f-4fa3-b85a-80b1783906c4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:17.770399 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-2fc35bbf-175f-4fa3-b85a-80b1783906c4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.214001 Jun 07 13:15:17.770983 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 156/317] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:17 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:17.976948 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2c8d9eaf-58f0-4056-a5d7-964d5bd8c67c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:17.977562 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2c8d9eaf-58f0-4056-a5d7-964d5bd8c67c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:17.983623 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2c8d9eaf-58f0-4056-a5d7-964d5bd8c67c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:17.984079 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2c8d9eaf-58f0-4056-a5d7-964d5bd8c67c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:17.984929 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2c8d9eaf-58f0-4056-a5d7-964d5bd8c67c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:17.985371 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2c8d9eaf-58f0-4056-a5d7-964d5bd8c67c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:18.117172 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2c8d9eaf-58f0-4056-a5d7-964d5bd8c67c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:18.125018 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2c8d9eaf-58f0-4056-a5d7-964d5bd8c67c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.151993 Jun 07 13:15:18.126067 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 162/318] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:17 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:18.245736 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9e3084e3-3117-4b38-af81-6bf263da6550 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:18.246336 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9e3084e3-3117-4b38-af81-6bf263da6550 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:18.253786 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e3084e3-3117-4b38-af81-6bf263da6550 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:18.254267 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e3084e3-3117-4b38-af81-6bf263da6550 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:18.255081 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e3084e3-3117-4b38-af81-6bf263da6550 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:18.255531 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e3084e3-3117-4b38-af81-6bf263da6550 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:18.395851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9e3084e3-3117-4b38-af81-6bf263da6550 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:18.404685 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9e3084e3-3117-4b38-af81-6bf263da6550 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:18.406271 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9e3084e3-3117-4b38-af81-6bf263da6550 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:18.407550 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9e3084e3-3117-4b38-af81-6bf263da6550 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.165701 Jun 07 13:15:18.408133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 157/319] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:18 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:18.790895 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-31ae3ab5-d925-4bb5-bbf3-a5fac434e7ab tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:18.791728 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-31ae3ab5-d925-4bb5-bbf3-a5fac434e7ab tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:18.799038 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-31ae3ab5-d925-4bb5-bbf3-a5fac434e7ab tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:18.799950 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-31ae3ab5-d925-4bb5-bbf3-a5fac434e7ab tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:18.800876 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-31ae3ab5-d925-4bb5-bbf3-a5fac434e7ab tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:18.801470 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-31ae3ab5-d925-4bb5-bbf3-a5fac434e7ab tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:18.976011 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-31ae3ab5-d925-4bb5-bbf3-a5fac434e7ab tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:18.983451 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-31ae3ab5-d925-4bb5-bbf3-a5fac434e7ab tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.196304 Jun 07 13:15:18.984242 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 163/320] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:18 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:19.141073 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5faa4320-c640-4cbc-a9ce-137c7c5bf890 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:19.141604 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5faa4320-c640-4cbc-a9ce-137c7c5bf890 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:19.148080 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5faa4320-c640-4cbc-a9ce-137c7c5bf890 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:19.148528 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5faa4320-c640-4cbc-a9ce-137c7c5bf890 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:19.149288 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5faa4320-c640-4cbc-a9ce-137c7c5bf890 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:19.149725 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5faa4320-c640-4cbc-a9ce-137c7c5bf890 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:19.314486 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5faa4320-c640-4cbc-a9ce-137c7c5bf890 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:19.325027 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5faa4320-c640-4cbc-a9ce-137c7c5bf890 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.187556 Jun 07 13:15:19.325689 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 158/321] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:19 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:19.425274 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3fe00210-f56c-4d7f-b121-87e704bc7c3a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:19.426594 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3fe00210-f56c-4d7f-b121-87e704bc7c3a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:19.442997 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3fe00210-f56c-4d7f-b121-87e704bc7c3a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:19.458722 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3fe00210-f56c-4d7f-b121-87e704bc7c3a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:19.459877 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3fe00210-f56c-4d7f-b121-87e704bc7c3a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:19.460082 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3fe00210-f56c-4d7f-b121-87e704bc7c3a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:19.599339 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3fe00210-f56c-4d7f-b121-87e704bc7c3a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:19.608403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3fe00210-f56c-4d7f-b121-87e704bc7c3a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:19.609958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3fe00210-f56c-4d7f-b121-87e704bc7c3a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:19.611188 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3fe00210-f56c-4d7f-b121-87e704bc7c3a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.189992 Jun 07 13:15:19.611773 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 164/322] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:19 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:15:20.002713 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b08c534d-943c-4336-9e3d-06bcbef96c2c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:20.004364 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b08c534d-943c-4336-9e3d-06bcbef96c2c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:20.017986 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:20.021898 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b08c534d-943c-4336-9e3d-06bcbef96c2c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:20.022602 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b08c534d-943c-4336-9e3d-06bcbef96c2c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:20.023447 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b08c534d-943c-4336-9e3d-06bcbef96c2c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:20.024096 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b08c534d-943c-4336-9e3d-06bcbef96c2c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:20.218093 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b08c534d-943c-4336-9e3d-06bcbef96c2c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:20.228004 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b08c534d-943c-4336-9e3d-06bcbef96c2c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1364 microversion: 2.1 time: 0.230812 Jun 07 13:15:20.229004 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 159/323] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:19 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:20.345322 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7d2efb01-d865-4e59-b7e6-e6b2c82d418c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:20.346189 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7d2efb01-d865-4e59-b7e6-e6b2c82d418c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:20.356377 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d2efb01-d865-4e59-b7e6-e6b2c82d418c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:20.356835 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d2efb01-d865-4e59-b7e6-e6b2c82d418c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:20.357625 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d2efb01-d865-4e59-b7e6-e6b2c82d418c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:20.358063 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d2efb01-d865-4e59-b7e6-e6b2c82d418c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:20.549664 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7d2efb01-d865-4e59-b7e6-e6b2c82d418c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:20.557934 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7d2efb01-d865-4e59-b7e6-e6b2c82d418c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.219475 Jun 07 13:15:20.558695 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 165/324] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:20 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:20.630083 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-06cc1768-2f55-489e-8007-60415fd9f0fb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:20.630733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-06cc1768-2f55-489e-8007-60415fd9f0fb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:20.638779 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-06cc1768-2f55-489e-8007-60415fd9f0fb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:20.639723 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-06cc1768-2f55-489e-8007-60415fd9f0fb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:20.640640 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-06cc1768-2f55-489e-8007-60415fd9f0fb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:20.641325 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-06cc1768-2f55-489e-8007-60415fd9f0fb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:20.799680 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-06cc1768-2f55-489e-8007-60415fd9f0fb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:20.809221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-06cc1768-2f55-489e-8007-60415fd9f0fb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:20.814146 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-06cc1768-2f55-489e-8007-60415fd9f0fb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:20.815474 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-06cc1768-2f55-489e-8007-60415fd9f0fb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.190346 Jun 07 13:15:20.826011 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 160/325] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:20 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:21.248001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9db9edbe-2718-44e3-88db-632cbe846563 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:21.249450 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9db9edbe-2718-44e3-88db-632cbe846563 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:21.256903 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9db9edbe-2718-44e3-88db-632cbe846563 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:21.257773 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9db9edbe-2718-44e3-88db-632cbe846563 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:21.258992 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9db9edbe-2718-44e3-88db-632cbe846563 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:21.259606 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9db9edbe-2718-44e3-88db-632cbe846563 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:21.450325 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9db9edbe-2718-44e3-88db-632cbe846563 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:21.459328 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9db9edbe-2718-44e3-88db-632cbe846563 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1550 microversion: 2.1 time: 0.216295 Jun 07 13:15:21.459895 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 166/326] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:21 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1550 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:21.478832 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-be46e1a6-bf62-4985-a11b-9d811ad95286 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:21.479401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-be46e1a6-bf62-4985-a11b-9d811ad95286 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:21.486886 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-be46e1a6-bf62-4985-a11b-9d811ad95286 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:21.487328 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-be46e1a6-bf62-4985-a11b-9d811ad95286 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:21.488087 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-be46e1a6-bf62-4985-a11b-9d811ad95286 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:21.488879 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-be46e1a6-bf62-4985-a11b-9d811ad95286 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:21.574236 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-84fec866-df20-4b95-9229-a63fad78ed50 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:21.575703 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-84fec866-df20-4b95-9229-a63fad78ed50 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:21.583144 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84fec866-df20-4b95-9229-a63fad78ed50 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:21.583308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-be46e1a6-bf62-4985-a11b-9d811ad95286 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109822 Jun 07 13:15:21.583677 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84fec866-df20-4b95-9229-a63fad78ed50 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:21.584712 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84fec866-df20-4b95-9229-a63fad78ed50 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:21.585473 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84fec866-df20-4b95-9229-a63fad78ed50 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:21.590281 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 161/327] 10.222.0.58 () {58 vars in 1274 bytes} [Tue Jun 7 13:15:21 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:15:21.842366 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ad7a6071-c06e-4648-be0c-d8a8523c95d8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:21.843479 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ad7a6071-c06e-4648-be0c-d8a8523c95d8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:21.853428 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ad7a6071-c06e-4648-be0c-d8a8523c95d8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:21.853990 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ad7a6071-c06e-4648-be0c-d8a8523c95d8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:21.855672 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ad7a6071-c06e-4648-be0c-d8a8523c95d8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:21.858346 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ad7a6071-c06e-4648-be0c-d8a8523c95d8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:21.910623 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-84fec866-df20-4b95-9229-a63fad78ed50 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:21.930109 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-84fec866-df20-4b95-9229-a63fad78ed50 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.358831 Jun 07 13:15:21.932517 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 167/328] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:21 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:22.053218 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ad7a6071-c06e-4648-be0c-d8a8523c95d8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:22.061493 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ad7a6071-c06e-4648-be0c-d8a8523c95d8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:22.064218 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ad7a6071-c06e-4648-be0c-d8a8523c95d8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:22.065573 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ad7a6071-c06e-4648-be0c-d8a8523c95d8 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.230838 Jun 07 13:15:22.066671 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 162/329] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:21 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:22.948686 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-27de6c0d-75c9-4b7c-9533-2cc040eb03ec tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:22.949458 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-27de6c0d-75c9-4b7c-9533-2cc040eb03ec tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:22.956327 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-27de6c0d-75c9-4b7c-9533-2cc040eb03ec tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:22.956888 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-27de6c0d-75c9-4b7c-9533-2cc040eb03ec tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:22.957867 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-27de6c0d-75c9-4b7c-9533-2cc040eb03ec tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:22.958500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-27de6c0d-75c9-4b7c-9533-2cc040eb03ec tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:23.084767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1c640dc4-5c84-4ed0-967b-c35d74144ff4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:23.089752 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1c640dc4-5c84-4ed0-967b-c35d74144ff4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:23.100469 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1c640dc4-5c84-4ed0-967b-c35d74144ff4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:23.101160 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1c640dc4-5c84-4ed0-967b-c35d74144ff4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:23.102214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1c640dc4-5c84-4ed0-967b-c35d74144ff4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:23.102965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1c640dc4-5c84-4ed0-967b-c35d74144ff4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:23.246402 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-27de6c0d-75c9-4b7c-9533-2cc040eb03ec tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:23.257319 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-27de6c0d-75c9-4b7c-9533-2cc040eb03ec tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.312384 Jun 07 13:15:23.258225 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 168/330] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:22 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:23.269664 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1c640dc4-5c84-4ed0-967b-c35d74144ff4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:23.278794 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1c640dc4-5c84-4ed0-967b-c35d74144ff4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:23.280673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1c640dc4-5c84-4ed0-967b-c35d74144ff4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:23.282571 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1c640dc4-5c84-4ed0-967b-c35d74144ff4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.202286 Jun 07 13:15:23.283589 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 163/331] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:23 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:15:23.341636 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-d0b926dd-a7e7-4a4c-812b-a608a9ae6c10 req-feaccc61-d7a9-4ec0-abae-3bada060075b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec72c48-4900-4d75-8fca-c5b6f5a287ca", "tag": "58128dcd-c6cf-4bd6-852b-7f5930478fbf"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:15:23.353101 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d0b926dd-a7e7-4a4c-812b-a608a9ae6c10 req-feaccc61-d7a9-4ec0-abae-3bada060075b service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:23.353886 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d0b926dd-a7e7-4a4c-812b-a608a9ae6c10 req-feaccc61-d7a9-4ec0-abae-3bada060075b service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:23.376731 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-d0b926dd-a7e7-4a4c-812b-a608a9ae6c10 req-feaccc61-d7a9-4ec0-abae-3bada060075b service nova] Creating event network-changed:58128dcd-c6cf-4bd6-852b-7f5930478fbf for instance dec72c48-4900-4d75-8fca-c5b6f5a287ca on hv-cinder-84496 Jun 07 13:15:23.385837 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-d0b926dd-a7e7-4a4c-812b-a608a9ae6c10 req-feaccc61-d7a9-4ec0-abae-3bada060075b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047694 Jun 07 13:15:23.394978 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 169/332] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:15:24.281159 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9e06ccf1-87ff-4703-98e4-e3ab01cd5fa4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:24.281159 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9e06ccf1-87ff-4703-98e4-e3ab01cd5fa4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:24.281159 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e06ccf1-87ff-4703-98e4-e3ab01cd5fa4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:24.282352 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e06ccf1-87ff-4703-98e4-e3ab01cd5fa4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:24.282863 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e06ccf1-87ff-4703-98e4-e3ab01cd5fa4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:24.283424 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e06ccf1-87ff-4703-98e4-e3ab01cd5fa4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:24.287638 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:24.303267 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0beda379-625d-4adb-a6fe-f9ead2e3906e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:24.304608 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0beda379-625d-4adb-a6fe-f9ead2e3906e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:24.310913 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0beda379-625d-4adb-a6fe-f9ead2e3906e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:24.311358 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0beda379-625d-4adb-a6fe-f9ead2e3906e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:24.312147 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0beda379-625d-4adb-a6fe-f9ead2e3906e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:24.312578 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0beda379-625d-4adb-a6fe-f9ead2e3906e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:24.435931 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9e06ccf1-87ff-4703-98e4-e3ab01cd5fa4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:24.444986 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9e06ccf1-87ff-4703-98e4-e3ab01cd5fa4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.174376 Jun 07 13:15:24.445783 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 164/333] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:24 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:24.498963 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0beda379-625d-4adb-a6fe-f9ead2e3906e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:24.507211 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0beda379-625d-4adb-a6fe-f9ead2e3906e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:24.508779 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0beda379-625d-4adb-a6fe-f9ead2e3906e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:24.509806 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0beda379-625d-4adb-a6fe-f9ead2e3906e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.212645 Jun 07 13:15:24.510357 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 170/334] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:24 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:25.461651 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ef0aa9f4-86c5-4423-b73a-7ae795d3fc94 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:25.462359 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ef0aa9f4-86c5-4423-b73a-7ae795d3fc94 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:25.468462 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ef0aa9f4-86c5-4423-b73a-7ae795d3fc94 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:25.468943 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ef0aa9f4-86c5-4423-b73a-7ae795d3fc94 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:25.469702 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ef0aa9f4-86c5-4423-b73a-7ae795d3fc94 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:25.470133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ef0aa9f4-86c5-4423-b73a-7ae795d3fc94 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:25.536515 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a5386d17-dcd1-4d2d-9bc9-4c421b71fa9c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:25.537055 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a5386d17-dcd1-4d2d-9bc9-4c421b71fa9c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:25.545077 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a5386d17-dcd1-4d2d-9bc9-4c421b71fa9c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:25.545569 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a5386d17-dcd1-4d2d-9bc9-4c421b71fa9c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:25.546345 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a5386d17-dcd1-4d2d-9bc9-4c421b71fa9c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:25.546816 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a5386d17-dcd1-4d2d-9bc9-4c421b71fa9c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:25.629459 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ef0aa9f4-86c5-4423-b73a-7ae795d3fc94 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:25.638765 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ef0aa9f4-86c5-4423-b73a-7ae795d3fc94 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.180820 Jun 07 13:15:25.639540 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 165/335] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:25 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:25.729300 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a5386d17-dcd1-4d2d-9bc9-4c421b71fa9c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:25.731894 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:25.740339 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a5386d17-dcd1-4d2d-9bc9-4c421b71fa9c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:25.741848 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a5386d17-dcd1-4d2d-9bc9-4c421b71fa9c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:25.743481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a5386d17-dcd1-4d2d-9bc9-4c421b71fa9c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.211357 Jun 07 13:15:25.744538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 171/336] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:25 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:25.811521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-beac1bd0-e7c8-43ec-a3d2-e0e536bbbe8e req-8b82bac3-9099-4963-b041-27f71a3786c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0925b3-d41e-4935-abb7-e3566d134f26", "name": "network-vif-plugged", "status": "completed", "tag": "2fe156ca-e8ed-44a1-9a93-c8bcc91216e2"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:15:25.821029 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-beac1bd0-e7c8-43ec-a3d2-e0e536bbbe8e req-8b82bac3-9099-4963-b041-27f71a3786c7 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:25.821572 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-beac1bd0-e7c8-43ec-a3d2-e0e536bbbe8e req-8b82bac3-9099-4963-b041-27f71a3786c7 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:25.834751 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-beac1bd0-e7c8-43ec-a3d2-e0e536bbbe8e req-8b82bac3-9099-4963-b041-27f71a3786c7 service nova] Creating event network-vif-plugged:2fe156ca-e8ed-44a1-9a93-c8bcc91216e2 for instance 8d0925b3-d41e-4935-abb7-e3566d134f26 on hv-cinder-84496 Jun 07 13:15:25.843273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-beac1bd0-e7c8-43ec-a3d2-e0e536bbbe8e req-8b82bac3-9099-4963-b041-27f71a3786c7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036403 Jun 07 13:15:25.844386 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 166/337] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:15:26.657355 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-42992d94-8a1c-4e07-ac04-295322ba6c39 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:26.658080 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-42992d94-8a1c-4e07-ac04-295322ba6c39 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:26.661073 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=96 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:26.666971 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-42992d94-8a1c-4e07-ac04-295322ba6c39 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:26.667420 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-42992d94-8a1c-4e07-ac04-295322ba6c39 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:26.668185 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-42992d94-8a1c-4e07-ac04-295322ba6c39 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:26.668642 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-42992d94-8a1c-4e07-ac04-295322ba6c39 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:26.761634 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-25fdeea2-aec9-44a7-a769-beb7734a6f6b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:26.762978 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-25fdeea2-aec9-44a7-a769-beb7734a6f6b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:26.769217 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-25fdeea2-aec9-44a7-a769-beb7734a6f6b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:26.769666 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-25fdeea2-aec9-44a7-a769-beb7734a6f6b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:26.770425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-25fdeea2-aec9-44a7-a769-beb7734a6f6b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:26.770877 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-25fdeea2-aec9-44a7-a769-beb7734a6f6b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:26.869609 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-42992d94-8a1c-4e07-ac04-295322ba6c39 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:26.887567 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-42992d94-8a1c-4e07-ac04-295322ba6c39 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.225807 Jun 07 13:15:26.888484 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 172/338] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:26 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:26.915644 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-25fdeea2-aec9-44a7-a769-beb7734a6f6b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:26.924718 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-25fdeea2-aec9-44a7-a769-beb7734a6f6b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:26.926530 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-25fdeea2-aec9-44a7-a769-beb7734a6f6b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:26.927713 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-25fdeea2-aec9-44a7-a769-beb7734a6f6b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.170363 Jun 07 13:15:26.928419 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 167/339] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:26 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:15:27.904485 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-14d2ac9f-9455-4c11-945d-7b892f679484 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:27.905107 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-14d2ac9f-9455-4c11-945d-7b892f679484 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:27.911965 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14d2ac9f-9455-4c11-945d-7b892f679484 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:27.912416 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14d2ac9f-9455-4c11-945d-7b892f679484 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:27.913211 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14d2ac9f-9455-4c11-945d-7b892f679484 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:27.913625 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14d2ac9f-9455-4c11-945d-7b892f679484 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:27.948709 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e98d198b-e47e-484a-9f55-6c7b56b99aa5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:27.949534 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-e98d198b-e47e-484a-9f55-6c7b56b99aa5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:27.957598 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e98d198b-e47e-484a-9f55-6c7b56b99aa5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:27.958054 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e98d198b-e47e-484a-9f55-6c7b56b99aa5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:27.959026 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e98d198b-e47e-484a-9f55-6c7b56b99aa5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:27.959472 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e98d198b-e47e-484a-9f55-6c7b56b99aa5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:28.064769 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-14d2ac9f-9455-4c11-945d-7b892f679484 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:28.077360 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-14d2ac9f-9455-4c11-945d-7b892f679484 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.176574 Jun 07 13:15:28.077930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 173/340] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:27 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:28.120258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e98d198b-e47e-484a-9f55-6c7b56b99aa5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:28.129053 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e98d198b-e47e-484a-9f55-6c7b56b99aa5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:28.130682 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e98d198b-e47e-484a-9f55-6c7b56b99aa5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:28.131848 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e98d198b-e47e-484a-9f55-6c7b56b99aa5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.189197 Jun 07 13:15:28.132474 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 168/341] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:27 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:29.094861 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6f42d537-92f7-4322-8a05-40a0dfa39075 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:29.096065 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6f42d537-92f7-4322-8a05-40a0dfa39075 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:29.103947 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6f42d537-92f7-4322-8a05-40a0dfa39075 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:29.104391 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6f42d537-92f7-4322-8a05-40a0dfa39075 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:29.105152 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6f42d537-92f7-4322-8a05-40a0dfa39075 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:29.105580 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6f42d537-92f7-4322-8a05-40a0dfa39075 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:29.155575 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3be48370-c9d8-4120-84f2-0f57d031eaef tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:29.156960 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3be48370-c9d8-4120-84f2-0f57d031eaef tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:29.165650 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3be48370-c9d8-4120-84f2-0f57d031eaef tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:29.168603 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3be48370-c9d8-4120-84f2-0f57d031eaef tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:29.169412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3be48370-c9d8-4120-84f2-0f57d031eaef tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:29.169853 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3be48370-c9d8-4120-84f2-0f57d031eaef tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:29.259260 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6f42d537-92f7-4322-8a05-40a0dfa39075 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:29.267978 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6f42d537-92f7-4322-8a05-40a0dfa39075 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.177450 Jun 07 13:15:29.268668 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 174/342] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:29 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:29.309171 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3be48370-c9d8-4120-84f2-0f57d031eaef tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:29.317162 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3be48370-c9d8-4120-84f2-0f57d031eaef tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:29.318752 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3be48370-c9d8-4120-84f2-0f57d031eaef tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:29.319753 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3be48370-c9d8-4120-84f2-0f57d031eaef tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.173656 Jun 07 13:15:29.320300 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 169/343] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:29 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:30.285168 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-82853f28-b880-402f-8407-5c4dc2a89d11 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:30.286145 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-82853f28-b880-402f-8407-5c4dc2a89d11 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:30.292680 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-82853f28-b880-402f-8407-5c4dc2a89d11 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:30.293206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-82853f28-b880-402f-8407-5c4dc2a89d11 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:30.294070 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-82853f28-b880-402f-8407-5c4dc2a89d11 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:30.295047 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-82853f28-b880-402f-8407-5c4dc2a89d11 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:30.337060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f5126885-15de-4b8c-8979-f1c1f71190f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:30.337617 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f5126885-15de-4b8c-8979-f1c1f71190f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:30.343571 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f5126885-15de-4b8c-8979-f1c1f71190f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:30.344529 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f5126885-15de-4b8c-8979-f1c1f71190f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:30.345431 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f5126885-15de-4b8c-8979-f1c1f71190f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:30.346087 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f5126885-15de-4b8c-8979-f1c1f71190f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:30.448289 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-82853f28-b880-402f-8407-5c4dc2a89d11 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:30.455396 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-82853f28-b880-402f-8407-5c4dc2a89d11 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.174514 Jun 07 13:15:30.456813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 175/344] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:30 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:30.507210 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f5126885-15de-4b8c-8979-f1c1f71190f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:30.517486 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f5126885-15de-4b8c-8979-f1c1f71190f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:30.519997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f5126885-15de-4b8c-8979-f1c1f71190f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:30.522583 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f5126885-15de-4b8c-8979-f1c1f71190f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.188839 Jun 07 13:15:30.523395 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 170/345] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:30 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:15:31.472481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-436150e6-8672-4e93-b9ae-fccfd217ccc3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:31.473096 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-436150e6-8672-4e93-b9ae-fccfd217ccc3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:31.479566 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-436150e6-8672-4e93-b9ae-fccfd217ccc3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:31.480016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-436150e6-8672-4e93-b9ae-fccfd217ccc3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:31.480780 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-436150e6-8672-4e93-b9ae-fccfd217ccc3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:31.481217 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-436150e6-8672-4e93-b9ae-fccfd217ccc3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:31.542187 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-38dc72ba-bd97-4399-a194-25ad019f2cbf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:31.542835 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-38dc72ba-bd97-4399-a194-25ad019f2cbf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:31.549490 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-38dc72ba-bd97-4399-a194-25ad019f2cbf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:31.550013 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-38dc72ba-bd97-4399-a194-25ad019f2cbf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:31.550885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-38dc72ba-bd97-4399-a194-25ad019f2cbf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:31.551416 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-38dc72ba-bd97-4399-a194-25ad019f2cbf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:31.610018 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-436150e6-8672-4e93-b9ae-fccfd217ccc3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:31.618532 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-436150e6-8672-4e93-b9ae-fccfd217ccc3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.149835 Jun 07 13:15:31.619615 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 176/346] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:31 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:31.682485 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-38dc72ba-bd97-4399-a194-25ad019f2cbf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:31.690302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-38dc72ba-bd97-4399-a194-25ad019f2cbf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:31.691832 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-38dc72ba-bd97-4399-a194-25ad019f2cbf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:31.692919 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-38dc72ba-bd97-4399-a194-25ad019f2cbf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.154602 Jun 07 13:15:31.693474 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 171/347] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:31 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:15:32.635946 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8299e426-d416-4753-8db3-46082e4f24af tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:32.636563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8299e426-d416-4753-8db3-46082e4f24af tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:32.645693 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8299e426-d416-4753-8db3-46082e4f24af tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:32.646828 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8299e426-d416-4753-8db3-46082e4f24af tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:32.647979 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8299e426-d416-4753-8db3-46082e4f24af tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:32.649444 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8299e426-d416-4753-8db3-46082e4f24af tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:32.710538 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-38aec8a9-0e87-48fe-b987-72cc586b6f45 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:32.711149 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-38aec8a9-0e87-48fe-b987-72cc586b6f45 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:32.717219 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-38aec8a9-0e87-48fe-b987-72cc586b6f45 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:32.720744 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-38aec8a9-0e87-48fe-b987-72cc586b6f45 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:32.721949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-38aec8a9-0e87-48fe-b987-72cc586b6f45 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:32.722391 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-38aec8a9-0e87-48fe-b987-72cc586b6f45 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:32.790018 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8299e426-d416-4753-8db3-46082e4f24af tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:32.798880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8299e426-d416-4753-8db3-46082e4f24af tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.166463 Jun 07 13:15:32.799642 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 177/348] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:32 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:32.885742 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-38aec8a9-0e87-48fe-b987-72cc586b6f45 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:32.894724 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-38aec8a9-0e87-48fe-b987-72cc586b6f45 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:32.896962 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-38aec8a9-0e87-48fe-b987-72cc586b6f45 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:32.898455 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-38aec8a9-0e87-48fe-b987-72cc586b6f45 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.191623 Jun 07 13:15:32.910212 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 172/349] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:32 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:15:33.815308 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3f9700bd-ecb5-4dcc-910a-6b251915871a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:33.815937 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3f9700bd-ecb5-4dcc-910a-6b251915871a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:33.822062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3f9700bd-ecb5-4dcc-910a-6b251915871a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:33.822544 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3f9700bd-ecb5-4dcc-910a-6b251915871a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:33.823310 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3f9700bd-ecb5-4dcc-910a-6b251915871a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:33.823750 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3f9700bd-ecb5-4dcc-910a-6b251915871a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:33.916251 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d27e99de-6b06-4ca3-9c92-e94f3b4784f5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:33.916911 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d27e99de-6b06-4ca3-9c92-e94f3b4784f5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:33.922905 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d27e99de-6b06-4ca3-9c92-e94f3b4784f5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:33.923361 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d27e99de-6b06-4ca3-9c92-e94f3b4784f5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:33.924772 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d27e99de-6b06-4ca3-9c92-e94f3b4784f5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:33.925220 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d27e99de-6b06-4ca3-9c92-e94f3b4784f5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:34.022969 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3f9700bd-ecb5-4dcc-910a-6b251915871a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:34.030287 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3f9700bd-ecb5-4dcc-910a-6b251915871a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.218776 Jun 07 13:15:34.030885 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 178/350] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:33 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:34.055463 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d27e99de-6b06-4ca3-9c92-e94f3b4784f5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:34.063876 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d27e99de-6b06-4ca3-9c92-e94f3b4784f5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:34.065381 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d27e99de-6b06-4ca3-9c92-e94f3b4784f5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:34.066501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d27e99de-6b06-4ca3-9c92-e94f3b4784f5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.154072 Jun 07 13:15:34.067059 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 173/351] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:33 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:15:34.173315 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ad2c5129-2e62-4ce4-b1ee-4dd23ede043f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-291908863", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452", "networks": [{"uuid": "e0a5718f-678b-40e4-a7e6-9e48d8816072"}]}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:15:34.227756 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-ad2c5129-2e62-4ce4-b1ee-4dd23ede043f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] validate_networks() for [('e0a5718f-678b-40e4-a7e6-9e48d8816072', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:15:34.458507 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-f02d6884-ab54-4e92-af08-6759fd426bf4 req-cba493d5-9e47-41a2-ad21-a49b5bfcc24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64eec94b-9fac-4ad4-8386-01a27db4d5ce", "name": "network-vif-plugged", "status": "completed", "tag": "689501bc-bf08-4b3c-8c94-bc415ab172a1"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:15:34.472493 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-f02d6884-ab54-4e92-af08-6759fd426bf4 req-cba493d5-9e47-41a2-ad21-a49b5bfcc24f service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:34.474342 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-f02d6884-ab54-4e92-af08-6759fd426bf4 req-cba493d5-9e47-41a2-ad21-a49b5bfcc24f service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:34.496641 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-f02d6884-ab54-4e92-af08-6759fd426bf4 req-cba493d5-9e47-41a2-ad21-a49b5bfcc24f service nova] Creating event network-vif-plugged:689501bc-bf08-4b3c-8c94-bc415ab172a1 for instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce on hv-cinder-84496 Jun 07 13:15:34.506899 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-f02d6884-ab54-4e92-af08-6759fd426bf4 req-cba493d5-9e47-41a2-ad21-a49b5bfcc24f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053404 Jun 07 13:15:34.509285 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 174/352] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:15:34.873435 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-ad2c5129-2e62-4ce4-b1ee-4dd23ede043f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:15:34.873841 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-ad2c5129-2e62-4ce4-b1ee-4dd23ede043f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:15:34.874305 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-ad2c5129-2e62-4ce4-b1ee-4dd23ede043f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:15:34.874736 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-ad2c5129-2e62-4ce4-b1ee-4dd23ede043f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:15:34.875138 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-ad2c5129-2e62-4ce4-b1ee-4dd23ede043f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:15:34.884214 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ad2c5129-2e62-4ce4-b1ee-4dd23ede043f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:34.884654 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ad2c5129-2e62-4ce4-b1ee-4dd23ede043f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:34.885712 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ad2c5129-2e62-4ce4-b1ee-4dd23ede043f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:34.886146 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ad2c5129-2e62-4ce4-b1ee-4dd23ede043f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:34.901940 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-ad2c5129-2e62-4ce4-b1ee-4dd23ede043f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Getting quotas for project da750b8c0fae4e4695f1f511c408a389. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:15:34.905703 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-ad2c5129-2e62-4ce4-b1ee-4dd23ede043f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Getting quotas for user 22938ce89cd04ba79c0f851298adfb0f and project da750b8c0fae4e4695f1f511c408a389. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:15:34.917148 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ad2c5129-2e62-4ce4-b1ee-4dd23ede043f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:15:34.919363 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ad2c5129-2e62-4ce4-b1ee-4dd23ede043f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:15:34.965824 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ad2c5129-2e62-4ce4-b1ee-4dd23ede043f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796373 Jun 07 13:15:34.966385 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 179/353] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:15:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:15:34.978195 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5aef9a3a-fca9-4700-9e83-05fda9d51a9f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:34.978951 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5aef9a3a-fca9-4700-9e83-05fda9d51a9f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:35.034169 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5aef9a3a-fca9-4700-9e83-05fda9d51a9f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:35.041274 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5aef9a3a-fca9-4700-9e83-05fda9d51a9f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1213 microversion: 2.1 time: 0.067474 Jun 07 13:15:35.041838 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 175/354] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:34 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:35.056658 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-614f66b4-9c13-4584-b06e-79ab5b31d3bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:35.057266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-614f66b4-9c13-4584-b06e-79ab5b31d3bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:35.063615 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-614f66b4-9c13-4584-b06e-79ab5b31d3bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:35.064068 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-614f66b4-9c13-4584-b06e-79ab5b31d3bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:35.064823 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-614f66b4-9c13-4584-b06e-79ab5b31d3bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:35.066218 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-614f66b4-9c13-4584-b06e-79ab5b31d3bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:35.084522 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7bc697ee-1eaf-4087-aada-c75c56c81962 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:35.085217 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7bc697ee-1eaf-4087-aada-c75c56c81962 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:35.092040 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7bc697ee-1eaf-4087-aada-c75c56c81962 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:35.092505 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7bc697ee-1eaf-4087-aada-c75c56c81962 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:35.093295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7bc697ee-1eaf-4087-aada-c75c56c81962 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:35.094770 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7bc697ee-1eaf-4087-aada-c75c56c81962 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:35.246124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-614f66b4-9c13-4584-b06e-79ab5b31d3bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:35.256111 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-614f66b4-9c13-4584-b06e-79ab5b31d3bf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.203482 Jun 07 13:15:35.257476 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 180/355] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:35 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:35.274777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-7bc697ee-1eaf-4087-aada-c75c56c81962 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:35.284016 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-7bc697ee-1eaf-4087-aada-c75c56c81962 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:35.286081 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-7bc697ee-1eaf-4087-aada-c75c56c81962 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:35.287484 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-7bc697ee-1eaf-4087-aada-c75c56c81962 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.207061 Jun 07 13:15:35.288250 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 176/356] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:35 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:15:36.058158 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6c8b5e5b-f597-4bc4-93dd-eff9943f8ddb tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:36.059203 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6c8b5e5b-f597-4bc4-93dd-eff9943f8ddb tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:36.066394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c8b5e5b-f597-4bc4-93dd-eff9943f8ddb tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:36.067033 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c8b5e5b-f597-4bc4-93dd-eff9943f8ddb tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:36.067961 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c8b5e5b-f597-4bc4-93dd-eff9943f8ddb tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:36.068814 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c8b5e5b-f597-4bc4-93dd-eff9943f8ddb tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:36.139143 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6c8b5e5b-f597-4bc4-93dd-eff9943f8ddb tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:36.146810 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6c8b5e5b-f597-4bc4-93dd-eff9943f8ddb tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1209 microversion: 2.1 time: 0.092486 Jun 07 13:15:36.147396 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 181/357] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:36 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1209 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:36.273336 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-6893f577-b207-483d-b313-4d3cec9d6974 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:36.274080 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-6893f577-b207-483d-b313-4d3cec9d6974 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:36.287673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6893f577-b207-483d-b313-4d3cec9d6974 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:36.288135 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6893f577-b207-483d-b313-4d3cec9d6974 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:36.288944 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6893f577-b207-483d-b313-4d3cec9d6974 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:36.289373 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6893f577-b207-483d-b313-4d3cec9d6974 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:36.306213 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-85dbfa8f-7cfb-4a34-a0fb-df5c606d88b5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:36.307557 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-85dbfa8f-7cfb-4a34-a0fb-df5c606d88b5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:36.330071 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-85dbfa8f-7cfb-4a34-a0fb-df5c606d88b5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:36.332188 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-85dbfa8f-7cfb-4a34-a0fb-df5c606d88b5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:36.335953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-85dbfa8f-7cfb-4a34-a0fb-df5c606d88b5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:36.336592 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-85dbfa8f-7cfb-4a34-a0fb-df5c606d88b5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:36.453102 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-6893f577-b207-483d-b313-4d3cec9d6974 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:36.463545 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-6893f577-b207-483d-b313-4d3cec9d6974 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1322 microversion: 2.1 time: 0.194236 Jun 07 13:15:36.464695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 177/358] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:36 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:36.555920 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-85dbfa8f-7cfb-4a34-a0fb-df5c606d88b5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:36.564947 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-85dbfa8f-7cfb-4a34-a0fb-df5c606d88b5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:36.566459 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-85dbfa8f-7cfb-4a34-a0fb-df5c606d88b5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:36.567759 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-85dbfa8f-7cfb-4a34-a0fb-df5c606d88b5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.266426 Jun 07 13:15:36.568312 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 182/359] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:36 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:15:37.165326 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7a9bb0d7-a688-4601-b577-c2431578764b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:37.165932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7a9bb0d7-a688-4601-b577-c2431578764b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:37.172725 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7a9bb0d7-a688-4601-b577-c2431578764b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:37.173168 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7a9bb0d7-a688-4601-b577-c2431578764b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:37.174092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7a9bb0d7-a688-4601-b577-c2431578764b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:37.174800 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7a9bb0d7-a688-4601-b577-c2431578764b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:37.259670 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-7a9bb0d7-a688-4601-b577-c2431578764b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:37.267965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-7a9bb0d7-a688-4601-b577-c2431578764b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1265 microversion: 2.1 time: 0.106378 Jun 07 13:15:37.268749 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 178/360] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:37 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:37.481011 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6fc331dc-3c9a-4429-a992-c389a0079351 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:37.487814 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6fc331dc-3c9a-4429-a992-c389a0079351 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:37.494756 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6fc331dc-3c9a-4429-a992-c389a0079351 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:37.495210 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6fc331dc-3c9a-4429-a992-c389a0079351 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:37.495961 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6fc331dc-3c9a-4429-a992-c389a0079351 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:37.496391 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6fc331dc-3c9a-4429-a992-c389a0079351 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:37.586063 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-819ccce1-ae71-4a16-8db2-55fc7487472c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:37.586785 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-819ccce1-ae71-4a16-8db2-55fc7487472c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:37.593757 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-819ccce1-ae71-4a16-8db2-55fc7487472c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:37.594209 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-819ccce1-ae71-4a16-8db2-55fc7487472c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:37.595026 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-819ccce1-ae71-4a16-8db2-55fc7487472c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:37.595463 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-819ccce1-ae71-4a16-8db2-55fc7487472c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:37.632327 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6fc331dc-3c9a-4429-a992-c389a0079351 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:37.639825 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6fc331dc-3c9a-4429-a992-c389a0079351 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1516 microversion: 2.1 time: 0.162584 Jun 07 13:15:37.640575 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 183/361] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:37 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:37.657991 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6d124c4e-bd5c-4905-9961-4636a29d8920 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:15:37.664974 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6d124c4e-bd5c-4905-9961-4636a29d8920 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:37.666074 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6d124c4e-bd5c-4905-9961-4636a29d8920 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:37.666627 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6d124c4e-bd5c-4905-9961-4636a29d8920 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:37.667460 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6d124c4e-bd5c-4905-9961-4636a29d8920 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:37.668248 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6d124c4e-bd5c-4905-9961-4636a29d8920 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:37.691991 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-6d124c4e-bd5c-4905-9961-4636a29d8920 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lazy-loading 'flavor' on Instance uuid 8d0925b3-d41e-4935-abb7-e3566d134f26 {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:15:37.742048 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-819ccce1-ae71-4a16-8db2-55fc7487472c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:37.750948 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-819ccce1-ae71-4a16-8db2-55fc7487472c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:37.752729 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-819ccce1-ae71-4a16-8db2-55fc7487472c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:37.754001 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-819ccce1-ae71-4a16-8db2-55fc7487472c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1407 microversion: 2.20 time: 0.171780 Jun 07 13:15:37.754572 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 179/362] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:37 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:37.816672 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6d124c4e-bd5c-4905-9961-4636a29d8920 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "POST /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26/action" status: 200 len: 32 microversion: 2.1 time: 0.163069 Jun 07 13:15:37.817267 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 184/363] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jun 7 13:15:37 2022] POST /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 13:15:37.826297 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-cea56b0b-c5b3-4322-b000-69dcdf3ae11a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:37.827136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-cea56b0b-c5b3-4322-b000-69dcdf3ae11a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:37.833361 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cea56b0b-c5b3-4322-b000-69dcdf3ae11a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:37.833745 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cea56b0b-c5b3-4322-b000-69dcdf3ae11a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:37.834732 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cea56b0b-c5b3-4322-b000-69dcdf3ae11a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:37.835168 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cea56b0b-c5b3-4322-b000-69dcdf3ae11a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:37.972800 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cea56b0b-c5b3-4322-b000-69dcdf3ae11a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:37.980235 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-cea56b0b-c5b3-4322-b000-69dcdf3ae11a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.157870 Jun 07 13:15:37.980789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 180/364] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:37 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:38.286709 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8aa3feac-eb3c-4657-9b1b-91bb8d6aa0dc tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:38.287403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8aa3feac-eb3c-4657-9b1b-91bb8d6aa0dc tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:38.293766 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8aa3feac-eb3c-4657-9b1b-91bb8d6aa0dc tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:38.294703 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8aa3feac-eb3c-4657-9b1b-91bb8d6aa0dc tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:38.299088 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8aa3feac-eb3c-4657-9b1b-91bb8d6aa0dc tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:38.299551 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8aa3feac-eb3c-4657-9b1b-91bb8d6aa0dc tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:38.365086 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8aa3feac-eb3c-4657-9b1b-91bb8d6aa0dc tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:38.372966 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8aa3feac-eb3c-4657-9b1b-91bb8d6aa0dc tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1273 microversion: 2.1 time: 0.091934 Jun 07 13:15:38.374543 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 185/365] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:38 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:38.772465 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-04bb7809-2fd3-4126-a663-c5cd76da9b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:38.773079 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-04bb7809-2fd3-4126-a663-c5cd76da9b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:38.780225 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-04bb7809-2fd3-4126-a663-c5cd76da9b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:38.780999 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-04bb7809-2fd3-4126-a663-c5cd76da9b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:38.781953 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-04bb7809-2fd3-4126-a663-c5cd76da9b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:38.782574 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-04bb7809-2fd3-4126-a663-c5cd76da9b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:38.941966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-04bb7809-2fd3-4126-a663-c5cd76da9b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:38.949881 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-04bb7809-2fd3-4126-a663-c5cd76da9b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:38.951585 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-04bb7809-2fd3-4126-a663-c5cd76da9b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:38.952683 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-04bb7809-2fd3-4126-a663-c5cd76da9b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1598 microversion: 2.20 time: 0.184116 Jun 07 13:15:38.953381 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 181/366] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:15:38 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1598 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:15:38.970756 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-938636e2-fa4b-41ca-85e7-14e24fdcc484 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:38.971257 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-938636e2-fa4b-41ca-85e7-14e24fdcc484 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:38.977617 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-938636e2-fa4b-41ca-85e7-14e24fdcc484 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:38.978067 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-938636e2-fa4b-41ca-85e7-14e24fdcc484 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:38.978880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-938636e2-fa4b-41ca-85e7-14e24fdcc484 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:38.979301 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-938636e2-fa4b-41ca-85e7-14e24fdcc484 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:38.997090 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-eb929c19-e6bc-4f83-a707-79bbc31daa3c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:38.998067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-eb929c19-e6bc-4f83-a707-79bbc31daa3c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:39.005067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-eb929c19-e6bc-4f83-a707-79bbc31daa3c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:39.005715 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-eb929c19-e6bc-4f83-a707-79bbc31daa3c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:39.006511 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-eb929c19-e6bc-4f83-a707-79bbc31daa3c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:39.007199 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-eb929c19-e6bc-4f83-a707-79bbc31daa3c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:39.171309 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-eb929c19-e6bc-4f83-a707-79bbc31daa3c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:39.179066 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-938636e2-fa4b-41ca-85e7-14e24fdcc484 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.212052 Jun 07 13:15:39.180404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 186/367] 10.222.0.58 () {60 vars in 1315 bytes} [Tue Jun 7 13:15:38 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/os-interface => generated 284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:15:39.188675 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-eb929c19-e6bc-4f83-a707-79bbc31daa3c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.194525 Jun 07 13:15:39.189356 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 182/368] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:38 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:39.390280 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-47aa69d5-8b77-48de-89e1-76a845870f1b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:39.391142 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-47aa69d5-8b77-48de-89e1-76a845870f1b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:39.397629 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-47aa69d5-8b77-48de-89e1-76a845870f1b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:39.398180 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-47aa69d5-8b77-48de-89e1-76a845870f1b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:39.399245 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-47aa69d5-8b77-48de-89e1-76a845870f1b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:39.399762 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-47aa69d5-8b77-48de-89e1-76a845870f1b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:39.418585 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:39.472136 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-47aa69d5-8b77-48de-89e1-76a845870f1b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:39.478877 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-47aa69d5-8b77-48de-89e1-76a845870f1b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1271 microversion: 2.1 time: 0.092509 Jun 07 13:15:39.479440 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 187/369] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:39 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:40.206695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-90d3f823-8464-4c90-b3ba-973ec7c4dd18 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:40.207528 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-90d3f823-8464-4c90-b3ba-973ec7c4dd18 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:40.214504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-90d3f823-8464-4c90-b3ba-973ec7c4dd18 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:40.215593 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-90d3f823-8464-4c90-b3ba-973ec7c4dd18 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:40.216888 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-90d3f823-8464-4c90-b3ba-973ec7c4dd18 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:40.217516 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-90d3f823-8464-4c90-b3ba-973ec7c4dd18 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:40.223489 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:40.446359 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-90d3f823-8464-4c90-b3ba-973ec7c4dd18 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:40.459005 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-e5145692-8134-4b84-9a20-71c18ee8be2f req-b5775b21-15d2-465f-a951-5f40907d0c4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64eec94b-9fac-4ad4-8386-01a27db4d5ce", "tag": "689501bc-bf08-4b3c-8c94-bc415ab172a1"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:15:40.475011 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-90d3f823-8464-4c90-b3ba-973ec7c4dd18 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.267607 Jun 07 13:15:40.476019 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 183/370] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:40 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:40.478916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-e5145692-8134-4b84-9a20-71c18ee8be2f req-b5775b21-15d2-465f-a951-5f40907d0c4b service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:40.479362 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-e5145692-8134-4b84-9a20-71c18ee8be2f req-b5775b21-15d2-465f-a951-5f40907d0c4b service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:40.497481 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-aead064b-de1f-410d-aef3-7edd3d6211c6 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:40.498346 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-aead064b-de1f-410d-aef3-7edd3d6211c6 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:40.518282 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-aead064b-de1f-410d-aef3-7edd3d6211c6 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:40.518771 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-aead064b-de1f-410d-aef3-7edd3d6211c6 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:40.519554 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-aead064b-de1f-410d-aef3-7edd3d6211c6 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:40.519992 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-aead064b-de1f-410d-aef3-7edd3d6211c6 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:40.534934 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-e5145692-8134-4b84-9a20-71c18ee8be2f req-b5775b21-15d2-465f-a951-5f40907d0c4b service nova] Creating event network-changed:689501bc-bf08-4b3c-8c94-bc415ab172a1 for instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce on hv-cinder-84496 Jun 07 13:15:40.542236 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-e5145692-8134-4b84-9a20-71c18ee8be2f req-b5775b21-15d2-465f-a951-5f40907d0c4b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088250 Jun 07 13:15:40.543074 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 188/371] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:15:40.627955 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-aead064b-de1f-410d-aef3-7edd3d6211c6 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:40.638635 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-aead064b-de1f-410d-aef3-7edd3d6211c6 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1271 microversion: 2.1 time: 0.144676 Jun 07 13:15:40.640058 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 184/372] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:40 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:41.494823 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ce179198-0ebb-454d-953f-24a090aea828 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:41.496795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ce179198-0ebb-454d-953f-24a090aea828 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:41.517491 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ce179198-0ebb-454d-953f-24a090aea828 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:41.517935 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ce179198-0ebb-454d-953f-24a090aea828 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:41.518737 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ce179198-0ebb-454d-953f-24a090aea828 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:41.523069 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ce179198-0ebb-454d-953f-24a090aea828 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:41.658794 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9f2e0cb7-8ef1-4211-b1fd-43ea2642a3d8 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:41.661560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9f2e0cb7-8ef1-4211-b1fd-43ea2642a3d8 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:41.669717 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9f2e0cb7-8ef1-4211-b1fd-43ea2642a3d8 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:41.670400 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9f2e0cb7-8ef1-4211-b1fd-43ea2642a3d8 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:41.671457 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9f2e0cb7-8ef1-4211-b1fd-43ea2642a3d8 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:41.672050 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9f2e0cb7-8ef1-4211-b1fd-43ea2642a3d8 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:41.889400 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9f2e0cb7-8ef1-4211-b1fd-43ea2642a3d8 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:41.898259 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9f2e0cb7-8ef1-4211-b1fd-43ea2642a3d8 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1313 microversion: 2.1 time: 0.245595 Jun 07 13:15:41.899000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 185/373] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:41 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:42.191542 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ce179198-0ebb-454d-953f-24a090aea828 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:42.200818 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ce179198-0ebb-454d-953f-24a090aea828 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.711368 Jun 07 13:15:42.201711 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 189/374] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:41 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:42.462181 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c498a569-3608-4067-b163-ea5c11c86de9 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:42.462855 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c498a569-3608-4067-b163-ea5c11c86de9 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:42.472361 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c498a569-3608-4067-b163-ea5c11c86de9 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:42.473257 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c498a569-3608-4067-b163-ea5c11c86de9 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:42.474307 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c498a569-3608-4067-b163-ea5c11c86de9 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:42.475144 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c498a569-3608-4067-b163-ea5c11c86de9 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:42.505661 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c498a569-3608-4067-b163-ea5c11c86de9 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Going to try to terminate instance {{(pid=117797) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:15:42.646093 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c498a569-3608-4067-b163-ea5c11c86de9 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 204 len: 0 microversion: 2.1 time: 0.187068 Jun 07 13:15:42.647296 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 186/375] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:15:42 2022] DELETE /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:15:42.659319 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8033b923-987c-475f-803d-48f864c19ab1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:42.661632 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8033b923-987c-475f-803d-48f864c19ab1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:42.668561 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8033b923-987c-475f-803d-48f864c19ab1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:42.669236 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8033b923-987c-475f-803d-48f864c19ab1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:42.670487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8033b923-987c-475f-803d-48f864c19ab1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:42.671084 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8033b923-987c-475f-803d-48f864c19ab1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:42.918231 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-19300219-7c4b-45aa-8221-4ea47ee8ba4a tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:42.920010 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-19300219-7c4b-45aa-8221-4ea47ee8ba4a tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:42.929196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-19300219-7c4b-45aa-8221-4ea47ee8ba4a tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:42.930036 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-19300219-7c4b-45aa-8221-4ea47ee8ba4a tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:42.931328 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-19300219-7c4b-45aa-8221-4ea47ee8ba4a tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:42.932579 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-19300219-7c4b-45aa-8221-4ea47ee8ba4a tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:42.951117 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8033b923-987c-475f-803d-48f864c19ab1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:42.963639 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8033b923-987c-475f-803d-48f864c19ab1 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1554 microversion: 2.1 time: 0.312106 Jun 07 13:15:42.964241 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 190/376] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:42 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1554 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:43.153772 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-19300219-7c4b-45aa-8221-4ea47ee8ba4a tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:43.163118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-19300219-7c4b-45aa-8221-4ea47ee8ba4a tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1313 microversion: 2.1 time: 0.250791 Jun 07 13:15:43.163880 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 187/377] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:42 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:43.217673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f9afc6c9-6686-4411-a365-02503b23dd40 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:43.218868 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f9afc6c9-6686-4411-a365-02503b23dd40 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:43.233769 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f9afc6c9-6686-4411-a365-02503b23dd40 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:43.234813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f9afc6c9-6686-4411-a365-02503b23dd40 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:43.235597 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f9afc6c9-6686-4411-a365-02503b23dd40 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:43.236039 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f9afc6c9-6686-4411-a365-02503b23dd40 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:43.471036 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f9afc6c9-6686-4411-a365-02503b23dd40 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:43.479991 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f9afc6c9-6686-4411-a365-02503b23dd40 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.266265 Jun 07 13:15:43.480869 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 191/378] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:43 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:43.533160 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-712ce7b2-610f-449f-af1e-fee89e1290cc req-470743bf-ecc0-4c4b-b720-bcd9b6a77c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d571b5c-bb84-4f6c-9403-ea047d8856fc", "tag": "9ff96c60-d594-4ebe-bfb5-dea3f13a7446"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:15:43.551518 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-712ce7b2-610f-449f-af1e-fee89e1290cc req-470743bf-ecc0-4c4b-b720-bcd9b6a77c1a service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:43.552390 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-712ce7b2-610f-449f-af1e-fee89e1290cc req-470743bf-ecc0-4c4b-b720-bcd9b6a77c1a service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:43.568988 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-712ce7b2-610f-449f-af1e-fee89e1290cc req-470743bf-ecc0-4c4b-b720-bcd9b6a77c1a service nova] Creating event network-changed:9ff96c60-d594-4ebe-bfb5-dea3f13a7446 for instance 6d571b5c-bb84-4f6c-9403-ea047d8856fc on hv-cinder-84496 Jun 07 13:15:43.574019 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-712ce7b2-610f-449f-af1e-fee89e1290cc req-470743bf-ecc0-4c4b-b720-bcd9b6a77c1a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046941 Jun 07 13:15:43.574627 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 188/379] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:15:43.980897 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a7c498ad-bc50-4a97-a82e-db616ccc5523 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:43.981514 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a7c498ad-bc50-4a97-a82e-db616ccc5523 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:43.988734 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7c498ad-bc50-4a97-a82e-db616ccc5523 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:43.989187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7c498ad-bc50-4a97-a82e-db616ccc5523 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:43.989951 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7c498ad-bc50-4a97-a82e-db616ccc5523 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:43.990645 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7c498ad-bc50-4a97-a82e-db616ccc5523 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:44.133905 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a7c498ad-bc50-4a97-a82e-db616ccc5523 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:44.141872 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a7c498ad-bc50-4a97-a82e-db616ccc5523 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1554 microversion: 2.1 time: 0.164748 Jun 07 13:15:44.142464 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 192/380] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:43 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:44.181428 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1096780c-3227-4d29-b278-ae7517774514 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:44.182130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1096780c-3227-4d29-b278-ae7517774514 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:44.190106 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1096780c-3227-4d29-b278-ae7517774514 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:44.190902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1096780c-3227-4d29-b278-ae7517774514 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:44.191688 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1096780c-3227-4d29-b278-ae7517774514 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:44.191980 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1096780c-3227-4d29-b278-ae7517774514 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:44.407262 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1096780c-3227-4d29-b278-ae7517774514 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:44.417113 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1096780c-3227-4d29-b278-ae7517774514 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1313 microversion: 2.1 time: 0.239402 Jun 07 13:15:44.417525 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 189/381] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:44 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:44.498214 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-295d3a46-6576-478b-a035-f9ddf9acafa3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:44.499577 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-295d3a46-6576-478b-a035-f9ddf9acafa3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:44.507568 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-295d3a46-6576-478b-a035-f9ddf9acafa3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:44.508305 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-295d3a46-6576-478b-a035-f9ddf9acafa3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:44.509748 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-295d3a46-6576-478b-a035-f9ddf9acafa3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:44.510538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-295d3a46-6576-478b-a035-f9ddf9acafa3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:44.763202 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-295d3a46-6576-478b-a035-f9ddf9acafa3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:44.772754 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-295d3a46-6576-478b-a035-f9ddf9acafa3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.279792 Jun 07 13:15:44.774475 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 193/382] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:44 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:45.158920 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-890415bf-1e5d-4a69-ba0a-fe24782d5f68 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:45.159534 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-890415bf-1e5d-4a69-ba0a-fe24782d5f68 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:45.162000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=2 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:45.170428 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-890415bf-1e5d-4a69-ba0a-fe24782d5f68 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:45.171072 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-890415bf-1e5d-4a69-ba0a-fe24782d5f68 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:45.172085 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-890415bf-1e5d-4a69-ba0a-fe24782d5f68 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:45.172724 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-890415bf-1e5d-4a69-ba0a-fe24782d5f68 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:45.337944 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-890415bf-1e5d-4a69-ba0a-fe24782d5f68 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:45.348707 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-890415bf-1e5d-4a69-ba0a-fe24782d5f68 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1554 microversion: 2.1 time: 0.193648 Jun 07 13:15:45.349283 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 190/383] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:45 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:45.434528 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-395f5b49-5b01-45a7-8634-0398c24cf2f1 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:45.435124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-395f5b49-5b01-45a7-8634-0398c24cf2f1 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:45.437761 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:45.438561 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:45.445143 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-395f5b49-5b01-45a7-8634-0398c24cf2f1 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:45.445587 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-395f5b49-5b01-45a7-8634-0398c24cf2f1 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:45.446781 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-395f5b49-5b01-45a7-8634-0398c24cf2f1 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:45.447217 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-395f5b49-5b01-45a7-8634-0398c24cf2f1 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:45.790014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-68eb835b-c76a-4e89-b4ad-b89448e749b2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:45.791232 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-68eb835b-c76a-4e89-b4ad-b89448e749b2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:45.805090 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-68eb835b-c76a-4e89-b4ad-b89448e749b2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:45.805714 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-68eb835b-c76a-4e89-b4ad-b89448e749b2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:45.808764 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-68eb835b-c76a-4e89-b4ad-b89448e749b2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:45.810173 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-68eb835b-c76a-4e89-b4ad-b89448e749b2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:46.001080 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-68eb835b-c76a-4e89-b4ad-b89448e749b2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:46.009168 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-68eb835b-c76a-4e89-b4ad-b89448e749b2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.223825 Jun 07 13:15:46.010659 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 191/384] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:45 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:46.281537 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-395f5b49-5b01-45a7-8634-0398c24cf2f1 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:46.289913 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-395f5b49-5b01-45a7-8634-0398c24cf2f1 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1313 microversion: 2.1 time: 0.859183 Jun 07 13:15:46.290805 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 194/385] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:45 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1313 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:46.365985 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a8220d95-9b4f-4a9b-8f45-dd3ebbe2e8a4 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:46.367652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a8220d95-9b4f-4a9b-8f45-dd3ebbe2e8a4 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:46.375338 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a8220d95-9b4f-4a9b-8f45-dd3ebbe2e8a4 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:46.375788 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a8220d95-9b4f-4a9b-8f45-dd3ebbe2e8a4 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:46.376825 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a8220d95-9b4f-4a9b-8f45-dd3ebbe2e8a4 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:46.377440 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a8220d95-9b4f-4a9b-8f45-dd3ebbe2e8a4 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:46.533883 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a8220d95-9b4f-4a9b-8f45-dd3ebbe2e8a4 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:46.544270 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a8220d95-9b4f-4a9b-8f45-dd3ebbe2e8a4 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1554 microversion: 2.1 time: 0.182385 Jun 07 13:15:46.545132 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 192/386] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:46 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:47.007593 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-a6bf6484-0588-450f-b2e8-167a757c1c3d req-2d0e0d84-1abf-4b74-adc0-91994dbf0455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78e5cc8-7238-4286-aae7-13544b3bcb99", "name": "network-vif-deleted", "tag": "72137dbd-ac58-46a3-a21f-b1f0720047f9"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:15:47.017616 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-a6bf6484-0588-450f-b2e8-167a757c1c3d req-2d0e0d84-1abf-4b74-adc0-91994dbf0455 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:47.018062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-a6bf6484-0588-450f-b2e8-167a757c1c3d req-2d0e0d84-1abf-4b74-adc0-91994dbf0455 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:47.026483 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a87170b9-ab55-411a-870e-cd1ea6d9aee5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:47.027097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a87170b9-ab55-411a-870e-cd1ea6d9aee5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:47.032263 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-a6bf6484-0588-450f-b2e8-167a757c1c3d req-2d0e0d84-1abf-4b74-adc0-91994dbf0455 service nova] Creating event network-vif-deleted:72137dbd-ac58-46a3-a21f-b1f0720047f9 for instance c78e5cc8-7238-4286-aae7-13544b3bcb99 on hv-cinder-84496 Jun 07 13:15:47.037994 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-a6bf6484-0588-450f-b2e8-167a757c1c3d req-2d0e0d84-1abf-4b74-adc0-91994dbf0455 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037086 Jun 07 13:15:47.038155 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a87170b9-ab55-411a-870e-cd1ea6d9aee5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:47.038835 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a87170b9-ab55-411a-870e-cd1ea6d9aee5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:47.039242 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 195/387] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:15:47.040535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a87170b9-ab55-411a-870e-cd1ea6d9aee5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:47.041259 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a87170b9-ab55-411a-870e-cd1ea6d9aee5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:47.200968 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a87170b9-ab55-411a-870e-cd1ea6d9aee5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:47.209532 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a87170b9-ab55-411a-870e-cd1ea6d9aee5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.186848 Jun 07 13:15:47.210339 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 193/388] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:47 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:47.307227 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-83dad4ee-7f0c-4898-9f06-fd91e4450199 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:47.308412 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-83dad4ee-7f0c-4898-9f06-fd91e4450199 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:47.315591 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-83dad4ee-7f0c-4898-9f06-fd91e4450199 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:47.316281 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-83dad4ee-7f0c-4898-9f06-fd91e4450199 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:47.317055 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-83dad4ee-7f0c-4898-9f06-fd91e4450199 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:47.317497 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-83dad4ee-7f0c-4898-9f06-fd91e4450199 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:47.560991 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9afb7acc-903e-4b3a-b5df-50cdb94edf0e tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:47.562354 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9afb7acc-903e-4b3a-b5df-50cdb94edf0e tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:47.568742 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9afb7acc-903e-4b3a-b5df-50cdb94edf0e tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:47.569186 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9afb7acc-903e-4b3a-b5df-50cdb94edf0e tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:47.569948 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9afb7acc-903e-4b3a-b5df-50cdb94edf0e tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:47.570611 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9afb7acc-903e-4b3a-b5df-50cdb94edf0e tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:47.584858 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-83dad4ee-7f0c-4898-9f06-fd91e4450199 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:47.600650 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-83dad4ee-7f0c-4898-9f06-fd91e4450199 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1313 microversion: 2.1 time: 0.297351 Jun 07 13:15:47.602146 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 196/389] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:47 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:47.645476 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9afb7acc-903e-4b3a-b5df-50cdb94edf0e tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:47.653654 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9afb7acc-903e-4b3a-b5df-50cdb94edf0e tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1512 microversion: 2.1 time: 0.096342 Jun 07 13:15:47.665401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 194/390] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:47 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1512 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:48.226430 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c1f70af9-579d-4ec9-8d31-3ecaeb869a8d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:48.227075 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c1f70af9-579d-4ec9-8d31-3ecaeb869a8d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:48.233861 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c1f70af9-579d-4ec9-8d31-3ecaeb869a8d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:48.234315 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c1f70af9-579d-4ec9-8d31-3ecaeb869a8d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:48.235114 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c1f70af9-579d-4ec9-8d31-3ecaeb869a8d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:48.235854 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c1f70af9-579d-4ec9-8d31-3ecaeb869a8d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:48.439340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c1f70af9-579d-4ec9-8d31-3ecaeb869a8d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:48.449300 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c1f70af9-579d-4ec9-8d31-3ecaeb869a8d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.226991 Jun 07 13:15:48.450787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 197/391] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:48 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:48.618138 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1adb48b8-7d33-416d-a9fd-6fa1bc1736ea tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:48.618916 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1adb48b8-7d33-416d-a9fd-6fa1bc1736ea tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:48.626769 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1adb48b8-7d33-416d-a9fd-6fa1bc1736ea tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:48.627243 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1adb48b8-7d33-416d-a9fd-6fa1bc1736ea tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:48.628301 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1adb48b8-7d33-416d-a9fd-6fa1bc1736ea tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:48.628919 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1adb48b8-7d33-416d-a9fd-6fa1bc1736ea tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:48.673203 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f0ead072-599f-4f63-b4c7-46f53957286a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:48.674285 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f0ead072-599f-4f63-b4c7-46f53957286a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:48.680776 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f0ead072-599f-4f63-b4c7-46f53957286a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:48.681463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f0ead072-599f-4f63-b4c7-46f53957286a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:48.683482 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f0ead072-599f-4f63-b4c7-46f53957286a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:48.684125 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f0ead072-599f-4f63-b4c7-46f53957286a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:48.785203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1adb48b8-7d33-416d-a9fd-6fa1bc1736ea tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:48.793887 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1adb48b8-7d33-416d-a9fd-6fa1bc1736ea tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1313 microversion: 2.1 time: 0.179994 Jun 07 13:15:48.795096 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 195/392] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:48 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:48.798855 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f0ead072-599f-4f63-b4c7-46f53957286a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:48.808381 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f0ead072-599f-4f63-b4c7-46f53957286a tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1512 microversion: 2.1 time: 0.139924 Jun 07 13:15:48.809220 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 198/393] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:48 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1512 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:49.467702 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0476d0d0-719e-4f57-b018-541ff4d7ce78 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:49.468987 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0476d0d0-719e-4f57-b018-541ff4d7ce78 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:49.480825 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0476d0d0-719e-4f57-b018-541ff4d7ce78 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:49.481508 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0476d0d0-719e-4f57-b018-541ff4d7ce78 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:49.482161 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0476d0d0-719e-4f57-b018-541ff4d7ce78 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:49.482843 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0476d0d0-719e-4f57-b018-541ff4d7ce78 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:49.735039 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0476d0d0-719e-4f57-b018-541ff4d7ce78 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:49.757118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0476d0d0-719e-4f57-b018-541ff4d7ce78 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.293270 Jun 07 13:15:49.760636 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 196/394] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:49 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:49.812404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2da2f455-9c79-47dc-b8e3-adc249387b82 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:49.813012 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2da2f455-9c79-47dc-b8e3-adc249387b82 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:49.819817 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2da2f455-9c79-47dc-b8e3-adc249387b82 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:49.820453 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2da2f455-9c79-47dc-b8e3-adc249387b82 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:49.821265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2da2f455-9c79-47dc-b8e3-adc249387b82 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:49.821696 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2da2f455-9c79-47dc-b8e3-adc249387b82 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:49.828378 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-394998e3-8f76-4a2d-9b30-ee2072984d5c tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:49.829631 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-394998e3-8f76-4a2d-9b30-ee2072984d5c tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:49.851038 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-394998e3-8f76-4a2d-9b30-ee2072984d5c tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:49.853098 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-394998e3-8f76-4a2d-9b30-ee2072984d5c tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:49.854115 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-394998e3-8f76-4a2d-9b30-ee2072984d5c tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:49.854759 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-394998e3-8f76-4a2d-9b30-ee2072984d5c tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:49.907126 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-394998e3-8f76-4a2d-9b30-ee2072984d5c tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:49.907578 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-394998e3-8f76-4a2d-9b30-ee2072984d5c tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:49.908046 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-394998e3-8f76-4a2d-9b30-ee2072984d5c tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lazy-loading 'fault' on Instance uuid c78e5cc8-7238-4286-aae7-13544b3bcb99 {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:15:49.982372 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-394998e3-8f76-4a2d-9b30-ee2072984d5c tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdd6c0bab4493b8ca08dba39121542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81f8697586042119fcdac2b0e68ad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:49.991660 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-394998e3-8f76-4a2d-9b30-ee2072984d5c tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 200 len: 1351 microversion: 2.1 time: 0.169635 Jun 07 13:15:49.992255 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 197/395] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:49 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 1351 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:50.170214 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2da2f455-9c79-47dc-b8e3-adc249387b82 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:50.180273 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2da2f455-9c79-47dc-b8e3-adc249387b82 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1313 microversion: 2.1 time: 0.372188 Jun 07 13:15:50.181033 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 199/396] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:49 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:50.778425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-add1a8e1-713c-4299-80ee-573a2790c738 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:50.779769 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-add1a8e1-713c-4299-80ee-573a2790c738 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:50.784378 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:50.794187 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-add1a8e1-713c-4299-80ee-573a2790c738 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:50.794767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-add1a8e1-713c-4299-80ee-573a2790c738 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:50.795755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-add1a8e1-713c-4299-80ee-573a2790c738 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:50.797127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-add1a8e1-713c-4299-80ee-573a2790c738 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:50.816732 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:51.010157 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f7f21603-6273-4bb4-91da-4eadd86e2a80 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:51.011064 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f7f21603-6273-4bb4-91da-4eadd86e2a80 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:51.022018 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f7f21603-6273-4bb4-91da-4eadd86e2a80 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:51.022640 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f7f21603-6273-4bb4-91da-4eadd86e2a80 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:51.023841 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f7f21603-6273-4bb4-91da-4eadd86e2a80 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:51.024689 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f7f21603-6273-4bb4-91da-4eadd86e2a80 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:51.026543 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-add1a8e1-713c-4299-80ee-573a2790c738 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:51.038282 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-add1a8e1-713c-4299-80ee-573a2790c738 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.264738 Jun 07 13:15:51.044866 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-f7f21603-6273-4bb4-91da-4eadd86e2a80 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] HTTP exception thrown: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:51.050753 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 198/397] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:50 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f7f21603-6273-4bb4-91da-4eadd86e2a80 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Request method failure captured: Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 HTTP/1.1 Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08JshoB95VTTUQkir77-xy487fzwIF0KXTlxexeKZxCQMS88l0Mjp8hVMAhG6DXWUcdkgny7jgns0SaECcohNPGxKu2DkIgQpTG6V7CV0CjRrR51Vgn7wK9Y-O8VO0doiRTKD0SotHQUldwE4uw2oSiVp1L_LMVwQRpmBB5KDKkADU Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: f81f8697586042119fcdac2b0e68ad18 Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-DeleteServersTestJSON-244462710 Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:15:51.051851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:15:51.053140 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f81f8697586042119fcdac2b0e68ad18", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f81f8697586042119fcdac2b0e68ad18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f81f8697586042119fcdac2b0e68ad18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f81f8697586042119fcdac2b0e68ad18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:15:51.053140 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-DeleteServersTestJSON-244462710 Jun 07 13:15:51.053140 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: f81f8697586042119fcdac2b0e68ad18 Jun 07 13:15:51.053140 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-DeleteServersTestJSON-244462710 Jun 07 13:15:51.053140 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-DeleteServersTestJSON-244462710-project Jun 07 13:15:51.053140 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:15:51.053140 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:15:51.053140 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 8cfdd6c0bab4493b8ca08dba39121542 Jun 07 13:15:51.053140 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-DeleteServersTestJSON-244462710-project Jun 07 13:15:51.053140 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:15:51.053140 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:51.053140 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': 'c78e5cc8-7238-4286-aae7-13544b3bcb99'} Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:15:51.053829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:51.055016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:15:51.056062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f7f21603-6273-4bb4-91da-4eadd86e2a80 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Returning 404 to user: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:15:51.056062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f7f21603-6273-4bb4-91da-4eadd86e2a80 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 404 len: 111 microversion: 2.1 time: 0.048224 Jun 07 13:15:51.057473 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 200/398] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:51 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:15:51.204441 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-56b519b6-a911-4319-87f9-1f9fdfeedd85 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:51.205322 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-56b519b6-a911-4319-87f9-1f9fdfeedd85 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:51.209833 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b873f8a4-e4fe-44e8-8a77-59cd259278e5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:51.212971 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b873f8a4-e4fe-44e8-8a77-59cd259278e5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:51.216164 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-56b519b6-a911-4319-87f9-1f9fdfeedd85 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:51.216719 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-56b519b6-a911-4319-87f9-1f9fdfeedd85 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:51.219039 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-56b519b6-a911-4319-87f9-1f9fdfeedd85 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:51.219583 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-56b519b6-a911-4319-87f9-1f9fdfeedd85 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:51.228047 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b873f8a4-e4fe-44e8-8a77-59cd259278e5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:51.228890 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b873f8a4-e4fe-44e8-8a77-59cd259278e5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:51.230125 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b873f8a4-e4fe-44e8-8a77-59cd259278e5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:51.231869 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b873f8a4-e4fe-44e8-8a77-59cd259278e5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:51.262430 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-b873f8a4-e4fe-44e8-8a77-59cd259278e5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] HTTP exception thrown: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b873f8a4-e4fe-44e8-8a77-59cd259278e5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Request method failure captured: Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99/os-volume_attachments HTTP/1.1 Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08JshoB95VTTUQkir77-xy487fzwIF0KXTlxexeKZxCQMS88l0Mjp8hVMAhG6DXWUcdkgny7jgns0SaECcohNPGxKu2DkIgQpTG6V7CV0CjRrR51Vgn7wK9Y-O8VO0doiRTKD0SotHQUldwE4uw2oSiVp1L_LMVwQRpmBB5KDKkADU Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: f81f8697586042119fcdac2b0e68ad18 Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-DeleteServersTestJSON-244462710 Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:15:51.264083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:15:51.265312 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f81f8697586042119fcdac2b0e68ad18", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f81f8697586042119fcdac2b0e68ad18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f81f8697586042119fcdac2b0e68ad18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f81f8697586042119fcdac2b0e68ad18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:15:51.265312 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-DeleteServersTestJSON-244462710 Jun 07 13:15:51.265312 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: f81f8697586042119fcdac2b0e68ad18 Jun 07 13:15:51.265312 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-DeleteServersTestJSON-244462710 Jun 07 13:15:51.265312 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-DeleteServersTestJSON-244462710-project Jun 07 13:15:51.265312 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:15:51.265312 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:15:51.265312 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 8cfdd6c0bab4493b8ca08dba39121542 Jun 07 13:15:51.265312 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-DeleteServersTestJSON-244462710-project Jun 07 13:15:51.265312 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:15:51.265312 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:51.265312 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'server_id': 'c78e5cc8-7238-4286-aae7-13544b3bcb99'} Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:15:51.265983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:51.267132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:15:51.268237 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b873f8a4-e4fe-44e8-8a77-59cd259278e5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Returning 404 to user: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:15:51.268237 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b873f8a4-e4fe-44e8-8a77-59cd259278e5 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.065581 Jun 07 13:15:51.303246 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 201/399] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:15:51 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99/os-volume_attachments => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:15:51.561266 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-56b519b6-a911-4319-87f9-1f9fdfeedd85 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:51.572900 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-56b519b6-a911-4319-87f9-1f9fdfeedd85 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1313 microversion: 2.1 time: 0.376476 Jun 07 13:15:51.584281 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 199/400] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:51 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:52.071976 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5e18023c-7684-48cf-85c5-3813a72719cf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:52.073045 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5e18023c-7684-48cf-85c5-3813a72719cf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:52.082491 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e18023c-7684-48cf-85c5-3813a72719cf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:52.082953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e18023c-7684-48cf-85c5-3813a72719cf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:52.083843 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e18023c-7684-48cf-85c5-3813a72719cf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:52.084268 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e18023c-7684-48cf-85c5-3813a72719cf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:52.278336 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5e18023c-7684-48cf-85c5-3813a72719cf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:52.289221 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5e18023c-7684-48cf-85c5-3813a72719cf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.222924 Jun 07 13:15:52.290605 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 202/401] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:52 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:52.562800 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e3da9ecd-9280-42cc-82c2-80a7ee9b9cb3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:52.563835 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-e3da9ecd-9280-42cc-82c2-80a7ee9b9cb3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:52.571042 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e3da9ecd-9280-42cc-82c2-80a7ee9b9cb3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:52.571719 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e3da9ecd-9280-42cc-82c2-80a7ee9b9cb3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:52.572707 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e3da9ecd-9280-42cc-82c2-80a7ee9b9cb3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:52.573348 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e3da9ecd-9280-42cc-82c2-80a7ee9b9cb3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:52.592100 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c36527f9-88a9-4a6d-9ca9-cf33dd0fd182 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:52.593486 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c36527f9-88a9-4a6d-9ca9-cf33dd0fd182 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:52.602408 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c36527f9-88a9-4a6d-9ca9-cf33dd0fd182 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:52.603067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-e3da9ecd-9280-42cc-82c2-80a7ee9b9cb3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] HTTP exception thrown: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:52.607950 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c36527f9-88a9-4a6d-9ca9-cf33dd0fd182 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:52.609591 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c36527f9-88a9-4a6d-9ca9-cf33dd0fd182 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:52.610164 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c36527f9-88a9-4a6d-9ca9-cf33dd0fd182 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e3da9ecd-9280-42cc-82c2-80a7ee9b9cb3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Request method failure captured: Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: DELETE /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 HTTP/1.1 Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08JshoB95VTTUQkir77-xy487fzwIF0KXTlxexeKZxCQMS88l0Mjp8hVMAhG6DXWUcdkgny7jgns0SaECcohNPGxKu2DkIgQpTG6V7CV0CjRrR51Vgn7wK9Y-O8VO0doiRTKD0SotHQUldwE4uw2oSiVp1L_LMVwQRpmBB5KDKkADU Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: f81f8697586042119fcdac2b0e68ad18 Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-DeleteServersTestJSON-244462710 Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:15:52.614763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:15:52.616295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f81f8697586042119fcdac2b0e68ad18", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f81f8697586042119fcdac2b0e68ad18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f81f8697586042119fcdac2b0e68ad18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f81f8697586042119fcdac2b0e68ad18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:15:52.616295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-DeleteServersTestJSON-244462710 Jun 07 13:15:52.616295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: f81f8697586042119fcdac2b0e68ad18 Jun 07 13:15:52.616295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-DeleteServersTestJSON-244462710 Jun 07 13:15:52.616295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-DeleteServersTestJSON-244462710-project Jun 07 13:15:52.616295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:15:52.616295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:15:52.616295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 8cfdd6c0bab4493b8ca08dba39121542 Jun 07 13:15:52.616295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-DeleteServersTestJSON-244462710-project Jun 07 13:15:52.616295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:15:52.616295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:52.616295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': 'c78e5cc8-7238-4286-aae7-13544b3bcb99'} Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:15:52.617092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:52.618412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:15:52.622147 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e3da9ecd-9280-42cc-82c2-80a7ee9b9cb3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Returning 404 to user: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:15:52.623380 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e3da9ecd-9280-42cc-82c2-80a7ee9b9cb3 tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 404 len: 111 microversion: 2.1 time: 0.065506 Jun 07 13:15:52.624908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 200/402] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:15:52 2022] DELETE /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:15:52.637004 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3fb25b9c-195e-409e-9547-df8a05bcf30b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:52.645220 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3fb25b9c-195e-409e-9547-df8a05bcf30b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] [instance: c78e5cc8-7238-4286-aae7-13544b3bcb99] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:52.655032 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3fb25b9c-195e-409e-9547-df8a05bcf30b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:52.658943 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3fb25b9c-195e-409e-9547-df8a05bcf30b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:52.660074 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3fb25b9c-195e-409e-9547-df8a05bcf30b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:52.660971 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3fb25b9c-195e-409e-9547-df8a05bcf30b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:52.686528 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-3fb25b9c-195e-409e-9547-df8a05bcf30b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] HTTP exception thrown: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3fb25b9c-195e-409e-9547-df8a05bcf30b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Request method failure captured: Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 HTTP/1.1 Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08JshoB95VTTUQkir77-xy487fzwIF0KXTlxexeKZxCQMS88l0Mjp8hVMAhG6DXWUcdkgny7jgns0SaECcohNPGxKu2DkIgQpTG6V7CV0CjRrR51Vgn7wK9Y-O8VO0doiRTKD0SotHQUldwE4uw2oSiVp1L_LMVwQRpmBB5KDKkADU Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: f81f8697586042119fcdac2b0e68ad18 Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-DeleteServersTestJSON-244462710 Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:15:52.688587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:15:52.689763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f81f8697586042119fcdac2b0e68ad18", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f81f8697586042119fcdac2b0e68ad18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f81f8697586042119fcdac2b0e68ad18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f81f8697586042119fcdac2b0e68ad18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:15:52.689763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-DeleteServersTestJSON-244462710 Jun 07 13:15:52.689763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: f81f8697586042119fcdac2b0e68ad18 Jun 07 13:15:52.689763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-DeleteServersTestJSON-244462710 Jun 07 13:15:52.689763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-DeleteServersTestJSON-244462710-project Jun 07 13:15:52.689763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:15:52.689763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:15:52.689763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 8cfdd6c0bab4493b8ca08dba39121542 Jun 07 13:15:52.689763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-DeleteServersTestJSON-244462710-project Jun 07 13:15:52.689763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:15:52.689763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:52.689763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': 'c78e5cc8-7238-4286-aae7-13544b3bcb99'} Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:15:52.690406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. Jun 07 13:15:52.691501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:15:52.692461 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3fb25b9c-195e-409e-9547-df8a05bcf30b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] Returning 404 to user: Instance c78e5cc8-7238-4286-aae7-13544b3bcb99 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:15:52.692461 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3fb25b9c-195e-409e-9547-df8a05bcf30b tempest-DeleteServersTestJSON-244462710 tempest-DeleteServersTestJSON-244462710-project] 10.222.0.58 "GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99" status: 404 len: 111 microversion: 2.1 time: 0.059350 Jun 07 13:15:52.703114 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 201/403] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:52 2022] GET /compute/v2.1/servers/c78e5cc8-7238-4286-aae7-13544b3bcb99 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:15:52.987605 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c36527f9-88a9-4a6d-9ca9-cf33dd0fd182 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:52.999771 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c36527f9-88a9-4a6d-9ca9-cf33dd0fd182 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1313 microversion: 2.1 time: 0.411012 Jun 07 13:15:53.004703 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 203/404] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:52 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:53.307028 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-4159bf10-4a2f-4981-9f92-8280d2151a67 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:53.307890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-4159bf10-4a2f-4981-9f92-8280d2151a67 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:53.319222 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4159bf10-4a2f-4981-9f92-8280d2151a67 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:53.319996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4159bf10-4a2f-4981-9f92-8280d2151a67 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:53.325694 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4159bf10-4a2f-4981-9f92-8280d2151a67 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:53.326358 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4159bf10-4a2f-4981-9f92-8280d2151a67 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:53.484596 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-a89cde55-94b2-425e-a099-d20fab9e254c req-8a5ed9ad-1ea1-4f15-a8d3-e89eae57a2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d571b5c-bb84-4f6c-9403-ea047d8856fc", "name": "network-vif-plugged", "status": "completed", "tag": "9ff96c60-d594-4ebe-bfb5-dea3f13a7446"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:15:53.498542 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-a89cde55-94b2-425e-a099-d20fab9e254c req-8a5ed9ad-1ea1-4f15-a8d3-e89eae57a2de service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:53.499271 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-a89cde55-94b2-425e-a099-d20fab9e254c req-8a5ed9ad-1ea1-4f15-a8d3-e89eae57a2de service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:53.544107 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-a89cde55-94b2-425e-a099-d20fab9e254c req-8a5ed9ad-1ea1-4f15-a8d3-e89eae57a2de service nova] Creating event network-vif-plugged:9ff96c60-d594-4ebe-bfb5-dea3f13a7446 for instance 6d571b5c-bb84-4f6c-9403-ea047d8856fc on hv-cinder-84496 Jun 07 13:15:53.557606 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-a89cde55-94b2-425e-a099-d20fab9e254c req-8a5ed9ad-1ea1-4f15-a8d3-e89eae57a2de service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076999 Jun 07 13:15:53.559024 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 204/405] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:15:53.664381 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-4159bf10-4a2f-4981-9f92-8280d2151a67 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:53.686730 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-4159bf10-4a2f-4981-9f92-8280d2151a67 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.384048 Jun 07 13:15:53.687652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 202/406] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:53 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:54.021280 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c1c7e791-c6d7-4f4f-a417-28d40c95a235 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:54.022221 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c1c7e791-c6d7-4f4f-a417-28d40c95a235 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:54.049388 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c1c7e791-c6d7-4f4f-a417-28d40c95a235 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:54.057611 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c1c7e791-c6d7-4f4f-a417-28d40c95a235 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:54.060139 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c1c7e791-c6d7-4f4f-a417-28d40c95a235 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:54.062556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c1c7e791-c6d7-4f4f-a417-28d40c95a235 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:54.532039 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c1c7e791-c6d7-4f4f-a417-28d40c95a235 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:54.545057 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c1c7e791-c6d7-4f4f-a417-28d40c95a235 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1313 microversion: 2.1 time: 0.527857 Jun 07 13:15:54.547040 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 205/407] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:54 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:54.704357 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f86d4968-6f15-4a32-afd9-101831017c33 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:54.705660 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f86d4968-6f15-4a32-afd9-101831017c33 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:54.729326 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f86d4968-6f15-4a32-afd9-101831017c33 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:54.730994 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f86d4968-6f15-4a32-afd9-101831017c33 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:54.732398 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f86d4968-6f15-4a32-afd9-101831017c33 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:54.738024 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f86d4968-6f15-4a32-afd9-101831017c33 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:55.102664 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f86d4968-6f15-4a32-afd9-101831017c33 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:55.140501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f86d4968-6f15-4a32-afd9-101831017c33 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.422729 Jun 07 13:15:55.141440 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 203/408] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:54 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:55.569463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d0ccaa79-6df3-4c48-b2de-13ccd68afec2 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:55.573673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d0ccaa79-6df3-4c48-b2de-13ccd68afec2 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:55.592757 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d0ccaa79-6df3-4c48-b2de-13ccd68afec2 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:55.593228 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d0ccaa79-6df3-4c48-b2de-13ccd68afec2 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:55.594000 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d0ccaa79-6df3-4c48-b2de-13ccd68afec2 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:55.595459 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d0ccaa79-6df3-4c48-b2de-13ccd68afec2 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:55.935674 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d0ccaa79-6df3-4c48-b2de-13ccd68afec2 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:55.976091 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d0ccaa79-6df3-4c48-b2de-13ccd68afec2 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1313 microversion: 2.1 time: 0.415908 Jun 07 13:15:55.984945 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 206/409] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:55 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:56.159224 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1f6f5d66-df23-4e6e-8b4c-6176dc391d2b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:56.159958 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1f6f5d66-df23-4e6e-8b4c-6176dc391d2b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:56.182357 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1f6f5d66-df23-4e6e-8b4c-6176dc391d2b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:56.184109 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1f6f5d66-df23-4e6e-8b4c-6176dc391d2b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:56.187483 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1f6f5d66-df23-4e6e-8b4c-6176dc391d2b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:56.188307 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1f6f5d66-df23-4e6e-8b4c-6176dc391d2b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:56.722140 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1f6f5d66-df23-4e6e-8b4c-6176dc391d2b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:56.757014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1f6f5d66-df23-4e6e-8b4c-6176dc391d2b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.601511 Jun 07 13:15:56.772423 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 204/410] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:56 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:57.002090 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b25b8f74-9279-48d5-9581-0034aa1fbae5 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:57.003425 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b25b8f74-9279-48d5-9581-0034aa1fbae5 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:57.011780 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:57.015238 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b25b8f74-9279-48d5-9581-0034aa1fbae5 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:57.016724 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b25b8f74-9279-48d5-9581-0034aa1fbae5 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:57.018225 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b25b8f74-9279-48d5-9581-0034aa1fbae5 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:57.018986 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b25b8f74-9279-48d5-9581-0034aa1fbae5 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:57.046766 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:57.307388 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b25b8f74-9279-48d5-9581-0034aa1fbae5 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:57.319883 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b25b8f74-9279-48d5-9581-0034aa1fbae5 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1495 microversion: 2.1 time: 0.322511 Jun 07 13:15:57.326195 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 207/411] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:56 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1495 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:57.777874 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-fddafc4a-953b-42bc-8cf6-a81a89f0a825 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:57.780798 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-fddafc4a-953b-42bc-8cf6-a81a89f0a825 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:57.794742 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fddafc4a-953b-42bc-8cf6-a81a89f0a825 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:57.798751 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fddafc4a-953b-42bc-8cf6-a81a89f0a825 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:57.800068 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fddafc4a-953b-42bc-8cf6-a81a89f0a825 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:57.800601 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fddafc4a-953b-42bc-8cf6-a81a89f0a825 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:58.071900 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1a1728ee-2d5c-403e-b530-624af80f77c7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:58.072413 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1a1728ee-2d5c-403e-b530-624af80f77c7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:58.085003 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1a1728ee-2d5c-403e-b530-624af80f77c7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:58.085967 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1a1728ee-2d5c-403e-b530-624af80f77c7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:58.088566 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1a1728ee-2d5c-403e-b530-624af80f77c7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:58.090997 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1a1728ee-2d5c-403e-b530-624af80f77c7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:58.107858 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-fddafc4a-953b-42bc-8cf6-a81a89f0a825 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:58.125273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-fddafc4a-953b-42bc-8cf6-a81a89f0a825 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.352024 Jun 07 13:15:58.131019 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1a1728ee-2d5c-403e-b530-624af80f77c7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:15:58.136459 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 205/412] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:57 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:58.301124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1a1728ee-2d5c-403e-b530-624af80f77c7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 204 len: 0 microversion: 2.1 time: 0.233211 Jun 07 13:15:58.301972 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 208/413] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:15:58 2022] DELETE /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 13:15:58.310010 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9f2bb0c9-45b2-49c3-820d-a078fdb5e577 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:58.310734 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9f2bb0c9-45b2-49c3-820d-a078fdb5e577 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:58.318875 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9f2bb0c9-45b2-49c3-820d-a078fdb5e577 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:58.320170 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9f2bb0c9-45b2-49c3-820d-a078fdb5e577 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:58.321202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9f2bb0c9-45b2-49c3-820d-a078fdb5e577 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:58.323012 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9f2bb0c9-45b2-49c3-820d-a078fdb5e577 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:58.580354 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9f2bb0c9-45b2-49c3-820d-a078fdb5e577 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:58.595299 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9f2bb0c9-45b2-49c3-820d-a078fdb5e577 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1501 microversion: 2.1 time: 0.285635 Jun 07 13:15:58.605842 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 206/414] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:58 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1501 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:58.672967 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4f445749-de81-4302-9a1d-aec2bc10970c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Action: 'create', calling method: .version_select at 0x7fb8f4169820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1885072570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuAlymTa0qmVy1XIGMM5t0iW+cE7MF+JxfUJWMcv/P7rKWGbOGzKAJ6c0M84DDBYkPqTiM6u1isZY5k/hnQ1sK04adPIxm//5wcixx/0whqdHz8dhPrNlqSb/RUDY35TQ=="}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:15:58.692471 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-4f445749-de81-4302-9a1d-aec2bc10970c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Getting quotas for project 992f495f37114f4c846ec55f37d7afd6. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:15:58.696790 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-4f445749-de81-4302-9a1d-aec2bc10970c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Getting quotas for user 906a40d3ab884e93a32cfca83204d34f and project 992f495f37114f4c846ec55f37d7afd6. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:15:58.723651 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4f445749-de81-4302-9a1d-aec2bc10970c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.336453 Jun 07 13:15:58.724376 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 209/415] 10.222.0.58 () {60 vars in 1158 bytes} [Tue Jun 7 13:15:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:15:59.143921 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f567a156-5215-4c98-b154-df294ccc9e84 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:59.144578 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f567a156-5215-4c98-b154-df294ccc9e84 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:59.151592 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f567a156-5215-4c98-b154-df294ccc9e84 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:59.155787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f567a156-5215-4c98-b154-df294ccc9e84 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:59.156871 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f567a156-5215-4c98-b154-df294ccc9e84 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:59.157715 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f567a156-5215-4c98-b154-df294ccc9e84 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:59.365950 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f567a156-5215-4c98-b154-df294ccc9e84 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:59.373945 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f567a156-5215-4c98-b154-df294ccc9e84 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.234324 Jun 07 13:15:59.376432 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 207/416] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:59 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:59.614604 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-176938bd-5615-4dbe-a376-b10b9edf7704 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:59.615949 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-176938bd-5615-4dbe-a376-b10b9edf7704 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:59.626724 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-176938bd-5615-4dbe-a376-b10b9edf7704 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:59.627342 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-176938bd-5615-4dbe-a376-b10b9edf7704 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:59.628502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-176938bd-5615-4dbe-a376-b10b9edf7704 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:59.629216 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-176938bd-5615-4dbe-a376-b10b9edf7704 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:59.894285 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-176938bd-5615-4dbe-a376-b10b9edf7704 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:59.909134 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-176938bd-5615-4dbe-a376-b10b9edf7704 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1501 microversion: 2.1 time: 0.300367 Jun 07 13:15:59.911906 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 210/417] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:59 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1501 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:00.395111 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0da7da90-a928-4d71-98fd-e0caca8c3592 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:00.397115 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0da7da90-a928-4d71-98fd-e0caca8c3592 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:00.411647 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0da7da90-a928-4d71-98fd-e0caca8c3592 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:00.412702 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0da7da90-a928-4d71-98fd-e0caca8c3592 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:00.416381 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0da7da90-a928-4d71-98fd-e0caca8c3592 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:00.416903 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0da7da90-a928-4d71-98fd-e0caca8c3592 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:00.666595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0da7da90-a928-4d71-98fd-e0caca8c3592 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:00.688606 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0da7da90-a928-4d71-98fd-e0caca8c3592 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.300408 Jun 07 13:16:00.700808 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 208/418] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:00 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:00.936945 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-473bf819-a743-4b0b-9f27-699e32d15780 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:00.937719 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-473bf819-a743-4b0b-9f27-699e32d15780 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:00.949559 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-473bf819-a743-4b0b-9f27-699e32d15780 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:00.950471 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-473bf819-a743-4b0b-9f27-699e32d15780 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:00.952494 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-473bf819-a743-4b0b-9f27-699e32d15780 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:00.954409 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-473bf819-a743-4b0b-9f27-699e32d15780 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:01.136139 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-473bf819-a743-4b0b-9f27-699e32d15780 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:01.163070 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-473bf819-a743-4b0b-9f27-699e32d15780 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 200 len: 1459 microversion: 2.1 time: 0.229838 Jun 07 13:16:01.170811 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 211/419] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:00 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 1459 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:01.174943 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-c0e56fe8-b045-4cd0-bb47-cef973b6c9df req-97299924-b013-48d9-a2f0-135e08e2b144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d571b5c-bb84-4f6c-9403-ea047d8856fc", "name": "network-vif-deleted", "tag": "9ff96c60-d594-4ebe-bfb5-dea3f13a7446"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:01.201751 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-c0e56fe8-b045-4cd0-bb47-cef973b6c9df req-97299924-b013-48d9-a2f0-135e08e2b144 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:01.204794 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-c0e56fe8-b045-4cd0-bb47-cef973b6c9df req-97299924-b013-48d9-a2f0-135e08e2b144 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:01.255349 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-c0e56fe8-b045-4cd0-bb47-cef973b6c9df req-97299924-b013-48d9-a2f0-135e08e2b144 service nova] Creating event network-vif-deleted:9ff96c60-d594-4ebe-bfb5-dea3f13a7446 for instance 6d571b5c-bb84-4f6c-9403-ea047d8856fc on hv-cinder-84496 Jun 07 13:16:01.264246 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-c0e56fe8-b045-4cd0-bb47-cef973b6c9df req-97299924-b013-48d9-a2f0-135e08e2b144 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118013 Jun 07 13:16:01.265691 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 209/420] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:16:01.708414 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-436c9ab7-efdc-4e48-bc66-b13d54031426 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:01.709005 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-436c9ab7-efdc-4e48-bc66-b13d54031426 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:01.716267 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-436c9ab7-efdc-4e48-bc66-b13d54031426 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:01.716844 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-436c9ab7-efdc-4e48-bc66-b13d54031426 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:01.717720 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-436c9ab7-efdc-4e48-bc66-b13d54031426 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:01.718158 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-436c9ab7-efdc-4e48-bc66-b13d54031426 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:01.922276 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-436c9ab7-efdc-4e48-bc66-b13d54031426 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:01.937645 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-436c9ab7-efdc-4e48-bc66-b13d54031426 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.234351 Jun 07 13:16:01.940118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 212/421] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:01 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:02.190328 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-bcd594b6-d836-445a-996a-acd144afdbe7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:02.191041 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-bcd594b6-d836-445a-996a-acd144afdbe7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 6d571b5c-bb84-4f6c-9403-ea047d8856fc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:02.197721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bcd594b6-d836-445a-996a-acd144afdbe7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:02.198239 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bcd594b6-d836-445a-996a-acd144afdbe7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:02.199061 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bcd594b6-d836-445a-996a-acd144afdbe7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:02.199489 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bcd594b6-d836-445a-996a-acd144afdbe7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:02.214624 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-bcd594b6-d836-445a-996a-acd144afdbe7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] HTTP exception thrown: Instance 6d571b5c-bb84-4f6c-9403-ea047d8856fc could not be found. Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-bcd594b6-d836-445a-996a-acd144afdbe7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Request method failure captured: Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc HTTP/1.1 Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin09ySYjqlUfCcbM0B2FC7q9kM5v0NDFFwKy2W_jzv-kECAPuj0yHqV7MHr5Khf04fiLe3SSODjdeavP1k3-SESuWHawj9ykyl6VrTFcnV9jHnESVua6bFDO9AoNMAR2C4JQe6dTxFzSjpkXC9_FOz70-l2Tr-KcXxzrhmXHiztN7jeQ Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: da750b8c0fae4e4695f1f511c408a389 Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-VolumesActionsTest-1355306392 Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:16:02.216287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:16:02.217521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_da750b8c0fae4e4695f1f511c408a389", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/da750b8c0fae4e4695f1f511c408a389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da750b8c0fae4e4695f1f511c408a389"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da750b8c0fae4e4695f1f511c408a389"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:16:02.217521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-VolumesActionsTest-1355306392 Jun 07 13:16:02.217521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: da750b8c0fae4e4695f1f511c408a389 Jun 07 13:16:02.217521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-VolumesActionsTest-1355306392 Jun 07 13:16:02.217521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-VolumesActionsTest-1355306392-project Jun 07 13:16:02.217521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:16:02.217521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:16:02.217521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 22938ce89cd04ba79c0f851298adfb0f Jun 07 13:16:02.217521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-VolumesActionsTest-1355306392-project Jun 07 13:16:02.217521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:16:02.217521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance 6d571b5c-bb84-4f6c-9403-ea047d8856fc could not be found. Jun 07 13:16:02.217521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': '6d571b5c-bb84-4f6c-9403-ea047d8856fc'} Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d571b5c-bb84-4f6c-9403-ea047d8856fc could not be found. Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:16:02.218221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d571b5c-bb84-4f6c-9403-ea047d8856fc could not be found. Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d571b5c-bb84-4f6c-9403-ea047d8856fc could not be found. Jun 07 13:16:02.219997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:16:02.221060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-bcd594b6-d836-445a-996a-acd144afdbe7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Returning 404 to user: Instance 6d571b5c-bb84-4f6c-9403-ea047d8856fc could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:16:02.221060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-bcd594b6-d836-445a-996a-acd144afdbe7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc" status: 404 len: 111 microversion: 2.1 time: 0.032204 Jun 07 13:16:02.221060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 210/422] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:02 2022] GET /compute/v2.1/servers/6d571b5c-bb84-4f6c-9403-ea047d8856fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:16:02.459065 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-01a00562-3713-45df-b18b-7c68ba6e7eb9 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1836204087", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452", "networks": [{"uuid": "e0a5718f-678b-40e4-a7e6-9e48d8816072"}]}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:02.552232 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-01a00562-3713-45df-b18b-7c68ba6e7eb9 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] validate_networks() for [('e0a5718f-678b-40e4-a7e6-9e48d8816072', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:16:02.965917 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-006f0a19-e57b-4a3b-aae8-ac3c48601c74 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:02.966584 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-006f0a19-e57b-4a3b-aae8-ac3c48601c74 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:02.985169 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-006f0a19-e57b-4a3b-aae8-ac3c48601c74 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:02.987103 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-006f0a19-e57b-4a3b-aae8-ac3c48601c74 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:02.988380 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-006f0a19-e57b-4a3b-aae8-ac3c48601c74 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:02.989089 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-006f0a19-e57b-4a3b-aae8-ac3c48601c74 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:03.128295 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-01a00562-3713-45df-b18b-7c68ba6e7eb9 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:16:03.129769 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-01a00562-3713-45df-b18b-7c68ba6e7eb9 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:16:03.130423 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-01a00562-3713-45df-b18b-7c68ba6e7eb9 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:16:03.131389 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-01a00562-3713-45df-b18b-7c68ba6e7eb9 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:16:03.132859 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-01a00562-3713-45df-b18b-7c68ba6e7eb9 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:16:03.146959 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-01a00562-3713-45df-b18b-7c68ba6e7eb9 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:03.147627 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-01a00562-3713-45df-b18b-7c68ba6e7eb9 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:03.148879 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-01a00562-3713-45df-b18b-7c68ba6e7eb9 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:03.149564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-01a00562-3713-45df-b18b-7c68ba6e7eb9 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:03.173098 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-01a00562-3713-45df-b18b-7c68ba6e7eb9 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Getting quotas for project da750b8c0fae4e4695f1f511c408a389. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:16:03.186892 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-01a00562-3713-45df-b18b-7c68ba6e7eb9 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Getting quotas for user 22938ce89cd04ba79c0f851298adfb0f and project da750b8c0fae4e4695f1f511c408a389. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:16:03.199642 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-01a00562-3713-45df-b18b-7c68ba6e7eb9 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:16:03.202987 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-01a00562-3713-45df-b18b-7c68ba6e7eb9 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:16:03.235054 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-006f0a19-e57b-4a3b-aae8-ac3c48601c74 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:03.247435 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-006f0a19-e57b-4a3b-aae8-ac3c48601c74 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.286391 Jun 07 13:16:03.249762 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 211/423] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:02 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:03.258724 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-01a00562-3713-45df-b18b-7c68ba6e7eb9 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809280 Jun 07 13:16:03.259357 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 213/424] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:16:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:16:03.271450 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-307b2071-88b3-4dd3-8072-0fc203c6cf3d tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:03.272063 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-307b2071-88b3-4dd3-8072-0fc203c6cf3d tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:03.384244 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-307b2071-88b3-4dd3-8072-0fc203c6cf3d tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:03.410257 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-307b2071-88b3-4dd3-8072-0fc203c6cf3d tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1214 microversion: 2.1 time: 0.142305 Jun 07 13:16:03.414001 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 212/425] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:03 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:04.265916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6d09725c-734d-498a-b2ed-826a722b9b15 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:04.266550 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6d09725c-734d-498a-b2ed-826a722b9b15 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:04.272516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6d09725c-734d-498a-b2ed-826a722b9b15 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:04.272959 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6d09725c-734d-498a-b2ed-826a722b9b15 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:04.273713 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6d09725c-734d-498a-b2ed-826a722b9b15 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:04.274146 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6d09725c-734d-498a-b2ed-826a722b9b15 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:04.422572 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6d09725c-734d-498a-b2ed-826a722b9b15 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:04.431389 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6d09725c-734d-498a-b2ed-826a722b9b15 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.170177 Jun 07 13:16:04.433397 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 214/426] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:04 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:04.446400 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5468b16b-bc00-4c01-9c04-6e258a6b737b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:04.447635 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5468b16b-bc00-4c01-9c04-6e258a6b737b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:04.454627 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5468b16b-bc00-4c01-9c04-6e258a6b737b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:04.455074 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5468b16b-bc00-4c01-9c04-6e258a6b737b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:04.455896 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5468b16b-bc00-4c01-9c04-6e258a6b737b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:04.456572 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5468b16b-bc00-4c01-9c04-6e258a6b737b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:04.530963 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5468b16b-bc00-4c01-9c04-6e258a6b737b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:04.539158 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5468b16b-bc00-4c01-9c04-6e258a6b737b tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1274 microversion: 2.1 time: 0.106378 Jun 07 13:16:04.540562 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 213/427] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:04 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:05.454536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-312ae2fa-c779-43e3-9e9c-6b53cf2568bd tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:05.455230 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-312ae2fa-c779-43e3-9e9c-6b53cf2568bd tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:05.461633 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-312ae2fa-c779-43e3-9e9c-6b53cf2568bd tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:05.462090 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-312ae2fa-c779-43e3-9e9c-6b53cf2568bd tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:05.462897 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-312ae2fa-c779-43e3-9e9c-6b53cf2568bd tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:05.463335 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-312ae2fa-c779-43e3-9e9c-6b53cf2568bd tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:05.556951 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e30aa3de-06b5-4f3e-a32b-ef3734b1b7cd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:05.557625 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-e30aa3de-06b5-4f3e-a32b-ef3734b1b7cd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:05.563814 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e30aa3de-06b5-4f3e-a32b-ef3734b1b7cd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:05.564554 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e30aa3de-06b5-4f3e-a32b-ef3734b1b7cd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:05.566177 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e30aa3de-06b5-4f3e-a32b-ef3734b1b7cd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:05.566662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e30aa3de-06b5-4f3e-a32b-ef3734b1b7cd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:05.698946 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e30aa3de-06b5-4f3e-a32b-ef3734b1b7cd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:05.708509 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-312ae2fa-c779-43e3-9e9c-6b53cf2568bd tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:05.715910 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e30aa3de-06b5-4f3e-a32b-ef3734b1b7cd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1314 microversion: 2.1 time: 0.162721 Jun 07 13:16:05.716496 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 214/428] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:05 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:16:05.719698 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-312ae2fa-c779-43e3-9e9c-6b53cf2568bd tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.273952 Jun 07 13:16:05.720263 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 215/429] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:05 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:16:06.141011 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-36887927-d03b-4845-a3d4-41be2921b080 req-ebd2d75f-30fa-4155-ab3a-bec1a7e572df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "873b7b4d-d379-41e9-b25f-17da66307b4a", "tag": "47faff83-87c7-4369-915c-03dec9101dfc"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:06.161971 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-36887927-d03b-4845-a3d4-41be2921b080 req-ebd2d75f-30fa-4155-ab3a-bec1a7e572df service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:06.162403 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-36887927-d03b-4845-a3d4-41be2921b080 req-ebd2d75f-30fa-4155-ab3a-bec1a7e572df service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:06.173211 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-36887927-d03b-4845-a3d4-41be2921b080 req-ebd2d75f-30fa-4155-ab3a-bec1a7e572df service nova] Creating event network-changed:47faff83-87c7-4369-915c-03dec9101dfc for instance 873b7b4d-d379-41e9-b25f-17da66307b4a on hv-cinder-84496 Jun 07 13:16:06.178362 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-36887927-d03b-4845-a3d4-41be2921b080 req-ebd2d75f-30fa-4155-ab3a-bec1a7e572df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042017 Jun 07 13:16:06.179139 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 215/430] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:16:06.733687 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8a86d926-a10a-4c7d-a4e5-b765b3e0ace3 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:06.734415 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8a86d926-a10a-4c7d-a4e5-b765b3e0ace3 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:06.736311 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-beeea492-86c8-4458-a914-d4ab9d2903fa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:06.737015 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-beeea492-86c8-4458-a914-d4ab9d2903fa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:06.741371 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a86d926-a10a-4c7d-a4e5-b765b3e0ace3 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:06.741836 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a86d926-a10a-4c7d-a4e5-b765b3e0ace3 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:06.742672 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a86d926-a10a-4c7d-a4e5-b765b3e0ace3 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:06.743109 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a86d926-a10a-4c7d-a4e5-b765b3e0ace3 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:06.743651 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-beeea492-86c8-4458-a914-d4ab9d2903fa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:06.744105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-beeea492-86c8-4458-a914-d4ab9d2903fa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:06.744878 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-beeea492-86c8-4458-a914-d4ab9d2903fa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:06.745315 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-beeea492-86c8-4458-a914-d4ab9d2903fa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:06.873571 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8a86d926-a10a-4c7d-a4e5-b765b3e0ace3 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:06.874345 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-beeea492-86c8-4458-a914-d4ab9d2903fa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:06.882289 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-beeea492-86c8-4458-a914-d4ab9d2903fa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.150523 Jun 07 13:16:06.882914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 216/431] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:06 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:16:06.883147 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8a86d926-a10a-4c7d-a4e5-b765b3e0ace3 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1314 microversion: 2.1 time: 0.153890 Jun 07 13:16:06.883790 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 216/432] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:06 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:07.899656 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-112d521c-759d-4988-8f05-0202c5655eca tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:07.900145 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-09d91d6a-d4ec-4d73-ae17-27927e54ca8d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:07.900508 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-09d91d6a-d4ec-4d73-ae17-27927e54ca8d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:07.900615 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-112d521c-759d-4988-8f05-0202c5655eca tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:07.906467 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-112d521c-759d-4988-8f05-0202c5655eca tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:07.906691 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-09d91d6a-d4ec-4d73-ae17-27927e54ca8d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:07.906924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-112d521c-759d-4988-8f05-0202c5655eca tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:07.907139 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-09d91d6a-d4ec-4d73-ae17-27927e54ca8d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:07.907685 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-112d521c-759d-4988-8f05-0202c5655eca tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:07.907955 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-09d91d6a-d4ec-4d73-ae17-27927e54ca8d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:07.908119 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-112d521c-759d-4988-8f05-0202c5655eca tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:07.908404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-09d91d6a-d4ec-4d73-ae17-27927e54ca8d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:08.038486 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-112d521c-759d-4988-8f05-0202c5655eca tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:08.039123 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-09d91d6a-d4ec-4d73-ae17-27927e54ca8d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:08.046387 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-112d521c-759d-4988-8f05-0202c5655eca tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1314 microversion: 2.1 time: 0.150546 Jun 07 13:16:08.047014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 217/433] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:07 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:08.047159 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-09d91d6a-d4ec-4d73-ae17-27927e54ca8d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.151267 Jun 07 13:16:08.047635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 217/434] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:07 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:09.063499 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-897623b6-d20e-4027-9194-242bf2bf25a4 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:09.064116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ebcc6cb8-0b2d-4952-b8ae-f6252cb21144 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:09.064116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ebcc6cb8-0b2d-4952-b8ae-f6252cb21144 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:09.064594 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-897623b6-d20e-4027-9194-242bf2bf25a4 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:09.070085 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ebcc6cb8-0b2d-4952-b8ae-f6252cb21144 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:09.070574 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ebcc6cb8-0b2d-4952-b8ae-f6252cb21144 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:09.070804 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-897623b6-d20e-4027-9194-242bf2bf25a4 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:09.071252 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-897623b6-d20e-4027-9194-242bf2bf25a4 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:09.071344 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ebcc6cb8-0b2d-4952-b8ae-f6252cb21144 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:09.071750 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ebcc6cb8-0b2d-4952-b8ae-f6252cb21144 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:09.072014 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-897623b6-d20e-4027-9194-242bf2bf25a4 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:09.072473 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-897623b6-d20e-4027-9194-242bf2bf25a4 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:09.202876 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-897623b6-d20e-4027-9194-242bf2bf25a4 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:09.206722 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ebcc6cb8-0b2d-4952-b8ae-f6252cb21144 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:09.210066 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-897623b6-d20e-4027-9194-242bf2bf25a4 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1314 microversion: 2.1 time: 0.150405 Jun 07 13:16:09.210699 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 218/435] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:09 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:09.214490 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ebcc6cb8-0b2d-4952-b8ae-f6252cb21144 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.154865 Jun 07 13:16:09.215057 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 218/436] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:09 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:10.226754 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-96e12cab-5d4e-437b-ac6c-b4106f789c5e tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:10.227362 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-96e12cab-5d4e-437b-ac6c-b4106f789c5e tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:10.231435 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8dad6026-085c-4364-90ae-b2ca6af86f9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:10.232043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8dad6026-085c-4364-90ae-b2ca6af86f9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:10.234303 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-96e12cab-5d4e-437b-ac6c-b4106f789c5e tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:10.234776 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-96e12cab-5d4e-437b-ac6c-b4106f789c5e tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:10.235531 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-96e12cab-5d4e-437b-ac6c-b4106f789c5e tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:10.235959 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-96e12cab-5d4e-437b-ac6c-b4106f789c5e tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:10.238467 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8dad6026-085c-4364-90ae-b2ca6af86f9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:10.238929 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8dad6026-085c-4364-90ae-b2ca6af86f9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:10.239685 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8dad6026-085c-4364-90ae-b2ca6af86f9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:10.240121 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8dad6026-085c-4364-90ae-b2ca6af86f9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:10.254540 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:10.369565 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-96e12cab-5d4e-437b-ac6c-b4106f789c5e tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:10.370021 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8dad6026-085c-4364-90ae-b2ca6af86f9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:10.377489 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8dad6026-085c-4364-90ae-b2ca6af86f9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.149980 Jun 07 13:16:10.386544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 219/437] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:10 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:16:10.386739 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-96e12cab-5d4e-437b-ac6c-b4106f789c5e tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1314 microversion: 2.1 time: 0.159083 Jun 07 13:16:10.386739 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 219/438] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:10 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:11.393999 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c6e4d9ef-819a-494d-bf90-885a42c0ee2f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:11.394644 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c6e4d9ef-819a-494d-bf90-885a42c0ee2f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:11.399629 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-687ba582-6b9c-4f8e-aba8-1787a2cdc675 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:11.400239 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-687ba582-6b9c-4f8e-aba8-1787a2cdc675 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:11.400618 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c6e4d9ef-819a-494d-bf90-885a42c0ee2f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:11.401065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c6e4d9ef-819a-494d-bf90-885a42c0ee2f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:11.401828 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c6e4d9ef-819a-494d-bf90-885a42c0ee2f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:11.402260 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c6e4d9ef-819a-494d-bf90-885a42c0ee2f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:11.407083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-687ba582-6b9c-4f8e-aba8-1787a2cdc675 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:11.407527 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-687ba582-6b9c-4f8e-aba8-1787a2cdc675 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:11.408282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-687ba582-6b9c-4f8e-aba8-1787a2cdc675 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:11.408714 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-687ba582-6b9c-4f8e-aba8-1787a2cdc675 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:11.540235 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c6e4d9ef-819a-494d-bf90-885a42c0ee2f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:11.540910 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-687ba582-6b9c-4f8e-aba8-1787a2cdc675 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:11.548460 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c6e4d9ef-819a-494d-bf90-885a42c0ee2f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.158292 Jun 07 13:16:11.548874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-687ba582-6b9c-4f8e-aba8-1787a2cdc675 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1314 microversion: 2.1 time: 0.152999 Jun 07 13:16:11.549557 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 220/439] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:11 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:11.549690 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 220/440] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:11 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:12.565573 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-fd13d2a0-eb3e-455b-bf68-587eddcabb03 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:12.566122 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-eb3af658-3a3c-4605-8bb4-892c3ab2a83a tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:12.566517 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-fd13d2a0-eb3e-455b-bf68-587eddcabb03 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:12.566672 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-eb3af658-3a3c-4605-8bb4-892c3ab2a83a tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:12.572472 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fd13d2a0-eb3e-455b-bf68-587eddcabb03 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:12.572617 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eb3af658-3a3c-4605-8bb4-892c3ab2a83a tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:12.572918 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fd13d2a0-eb3e-455b-bf68-587eddcabb03 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:12.573043 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eb3af658-3a3c-4605-8bb4-892c3ab2a83a tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:12.573679 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eb3af658-3a3c-4605-8bb4-892c3ab2a83a tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:12.573781 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fd13d2a0-eb3e-455b-bf68-587eddcabb03 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:12.574101 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fd13d2a0-eb3e-455b-bf68-587eddcabb03 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:12.574208 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eb3af658-3a3c-4605-8bb4-892c3ab2a83a tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:12.702583 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-eb3af658-3a3c-4605-8bb4-892c3ab2a83a tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:12.703055 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-fd13d2a0-eb3e-455b-bf68-587eddcabb03 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:12.710079 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-eb3af658-3a3c-4605-8bb4-892c3ab2a83a tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1314 microversion: 2.1 time: 0.148014 Jun 07 13:16:12.710681 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 221/441] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:12 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:16:12.710994 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-fd13d2a0-eb3e-455b-bf68-587eddcabb03 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.149728 Jun 07 13:16:12.711561 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 221/442] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:12 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:13.730932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2ee46715-2247-4fa0-abc1-d45bd7e4ac2d tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:13.731539 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2ee46715-2247-4fa0-abc1-d45bd7e4ac2d tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:13.733604 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f062db75-8f09-441f-8a35-727f06789650 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:13.734205 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f062db75-8f09-441f-8a35-727f06789650 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:13.736154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=2 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:13.741180 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:13.741846 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=10 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:13.748065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f062db75-8f09-441f-8a35-727f06789650 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:13.749178 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f062db75-8f09-441f-8a35-727f06789650 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:13.749943 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f062db75-8f09-441f-8a35-727f06789650 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:13.750652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f062db75-8f09-441f-8a35-727f06789650 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:13.751586 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ee46715-2247-4fa0-abc1-d45bd7e4ac2d tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:13.752244 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ee46715-2247-4fa0-abc1-d45bd7e4ac2d tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:13.753556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ee46715-2247-4fa0-abc1-d45bd7e4ac2d tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:13.754496 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ee46715-2247-4fa0-abc1-d45bd7e4ac2d tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:13.887775 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f062db75-8f09-441f-8a35-727f06789650 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:13.896695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f062db75-8f09-441f-8a35-727f06789650 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.173002 Jun 07 13:16:13.897411 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 222/443] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:13 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:14.097025 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2ee46715-2247-4fa0-abc1-d45bd7e4ac2d tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:14.104503 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2ee46715-2247-4fa0-abc1-d45bd7e4ac2d tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1314 microversion: 2.1 time: 0.377532 Jun 07 13:16:14.105068 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 222/444] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:13 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:14.915580 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-89dafbb7-44d2-4c95-9d0b-0b52d046f969 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:14.916106 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-89dafbb7-44d2-4c95-9d0b-0b52d046f969 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:14.922058 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-89dafbb7-44d2-4c95-9d0b-0b52d046f969 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:14.922533 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-89dafbb7-44d2-4c95-9d0b-0b52d046f969 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:14.923286 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-89dafbb7-44d2-4c95-9d0b-0b52d046f969 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:14.923718 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-89dafbb7-44d2-4c95-9d0b-0b52d046f969 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:15.052869 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-89dafbb7-44d2-4c95-9d0b-0b52d046f969 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:15.060302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-89dafbb7-44d2-4c95-9d0b-0b52d046f969 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.148744 Jun 07 13:16:15.060955 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 223/445] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:14 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:15.121353 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e3649c79-6351-4d6e-b6c3-2f5806b633bc tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:15.121967 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e3649c79-6351-4d6e-b6c3-2f5806b633bc tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:15.129235 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e3649c79-6351-4d6e-b6c3-2f5806b633bc tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:15.129687 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e3649c79-6351-4d6e-b6c3-2f5806b633bc tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:15.130481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e3649c79-6351-4d6e-b6c3-2f5806b633bc tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:15.130921 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e3649c79-6351-4d6e-b6c3-2f5806b633bc tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:15.268397 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e3649c79-6351-4d6e-b6c3-2f5806b633bc tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:15.276632 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e3649c79-6351-4d6e-b6c3-2f5806b633bc tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1314 microversion: 2.1 time: 0.159332 Jun 07 13:16:15.277469 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 223/446] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:15 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:16.076870 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-15de111a-a6f1-423e-8dfc-560a4f16a7fa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:16.077479 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-15de111a-a6f1-423e-8dfc-560a4f16a7fa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:16.083351 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-15de111a-a6f1-423e-8dfc-560a4f16a7fa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:16.084117 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-15de111a-a6f1-423e-8dfc-560a4f16a7fa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:16.084537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-15de111a-a6f1-423e-8dfc-560a4f16a7fa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:16.084968 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-15de111a-a6f1-423e-8dfc-560a4f16a7fa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:16.216014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-15de111a-a6f1-423e-8dfc-560a4f16a7fa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:16.224405 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-15de111a-a6f1-423e-8dfc-560a4f16a7fa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.151261 Jun 07 13:16:16.225211 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 224/447] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:16 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:16.293940 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c065686e-9027-4bbc-abf4-4edcf877e768 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:16.295185 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c065686e-9027-4bbc-abf4-4edcf877e768 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:16.302061 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c065686e-9027-4bbc-abf4-4edcf877e768 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:16.302658 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c065686e-9027-4bbc-abf4-4edcf877e768 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:16.303439 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c065686e-9027-4bbc-abf4-4edcf877e768 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:16.303871 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c065686e-9027-4bbc-abf4-4edcf877e768 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:16.308084 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:16.466884 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c065686e-9027-4bbc-abf4-4edcf877e768 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:16.475618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c065686e-9027-4bbc-abf4-4edcf877e768 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1314 microversion: 2.1 time: 0.186253 Jun 07 13:16:16.476507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 224/448] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:16 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:17.241455 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-65e3d1e6-e156-4e59-8ccc-fd171a86e0b0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:17.242187 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-65e3d1e6-e156-4e59-8ccc-fd171a86e0b0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:17.250120 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-65e3d1e6-e156-4e59-8ccc-fd171a86e0b0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:17.250626 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-65e3d1e6-e156-4e59-8ccc-fd171a86e0b0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:17.251399 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-65e3d1e6-e156-4e59-8ccc-fd171a86e0b0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:17.251864 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-65e3d1e6-e156-4e59-8ccc-fd171a86e0b0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:17.397741 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-65e3d1e6-e156-4e59-8ccc-fd171a86e0b0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:17.412344 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-65e3d1e6-e156-4e59-8ccc-fd171a86e0b0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.175066 Jun 07 13:16:17.412927 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 225/449] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:17 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:17.492548 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ed8c9746-9ff1-43f1-adcc-3caced7de666 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:17.493166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ed8c9746-9ff1-43f1-adcc-3caced7de666 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:17.499626 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed8c9746-9ff1-43f1-adcc-3caced7de666 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:17.500200 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed8c9746-9ff1-43f1-adcc-3caced7de666 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:17.500951 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed8c9746-9ff1-43f1-adcc-3caced7de666 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:17.501379 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed8c9746-9ff1-43f1-adcc-3caced7de666 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:17.630507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ed8c9746-9ff1-43f1-adcc-3caced7de666 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:17.637909 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ed8c9746-9ff1-43f1-adcc-3caced7de666 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1314 microversion: 2.1 time: 0.149071 Jun 07 13:16:17.638527 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 225/450] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:17 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:18.430689 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0c590072-60d6-42e5-b8a6-cd8d42af6465 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:18.432019 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0c590072-60d6-42e5-b8a6-cd8d42af6465 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:18.439027 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0c590072-60d6-42e5-b8a6-cd8d42af6465 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:18.439661 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0c590072-60d6-42e5-b8a6-cd8d42af6465 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:18.440710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0c590072-60d6-42e5-b8a6-cd8d42af6465 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:18.441633 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0c590072-60d6-42e5-b8a6-cd8d42af6465 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:18.540365 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-dc361d75-2677-4b56-954e-4c1848c87596 req-1ee388f1-f89f-450c-ba77-a9b9e607848d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873b7b4d-d379-41e9-b25f-17da66307b4a", "name": "network-vif-plugged", "status": "completed", "tag": "47faff83-87c7-4369-915c-03dec9101dfc"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:18.555402 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-dc361d75-2677-4b56-954e-4c1848c87596 req-1ee388f1-f89f-450c-ba77-a9b9e607848d service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:18.556094 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-dc361d75-2677-4b56-954e-4c1848c87596 req-1ee388f1-f89f-450c-ba77-a9b9e607848d service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:18.571412 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-dc361d75-2677-4b56-954e-4c1848c87596 req-1ee388f1-f89f-450c-ba77-a9b9e607848d service nova] Creating event network-vif-plugged:47faff83-87c7-4369-915c-03dec9101dfc for instance 873b7b4d-d379-41e9-b25f-17da66307b4a on hv-cinder-84496 Jun 07 13:16:18.579153 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-dc361d75-2677-4b56-954e-4c1848c87596 req-1ee388f1-f89f-450c-ba77-a9b9e607848d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044120 Jun 07 13:16:18.580218 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 226/451] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:16:18.584852 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0c590072-60d6-42e5-b8a6-cd8d42af6465 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:18.592513 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0c590072-60d6-42e5-b8a6-cd8d42af6465 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.166486 Jun 07 13:16:18.593278 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 226/452] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:18 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:18.655221 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-be66853c-2802-4c0c-82c4-4da2042785a7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:18.655929 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-be66853c-2802-4c0c-82c4-4da2042785a7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:18.662692 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-be66853c-2802-4c0c-82c4-4da2042785a7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:18.663144 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-be66853c-2802-4c0c-82c4-4da2042785a7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:18.663908 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-be66853c-2802-4c0c-82c4-4da2042785a7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:18.664349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-be66853c-2802-4c0c-82c4-4da2042785a7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:18.802328 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-be66853c-2802-4c0c-82c4-4da2042785a7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:18.811596 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-be66853c-2802-4c0c-82c4-4da2042785a7 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1314 microversion: 2.1 time: 0.159918 Jun 07 13:16:18.812166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 227/453] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:18 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:19.609274 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c819cd8b-28ce-4aac-ba74-e31bf2343a7d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:19.609879 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c819cd8b-28ce-4aac-ba74-e31bf2343a7d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:19.615861 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c819cd8b-28ce-4aac-ba74-e31bf2343a7d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:19.616315 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c819cd8b-28ce-4aac-ba74-e31bf2343a7d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:19.617068 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c819cd8b-28ce-4aac-ba74-e31bf2343a7d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:19.617504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c819cd8b-28ce-4aac-ba74-e31bf2343a7d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:19.752211 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c819cd8b-28ce-4aac-ba74-e31bf2343a7d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:19.759845 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c819cd8b-28ce-4aac-ba74-e31bf2343a7d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.154473 Jun 07 13:16:19.760403 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 227/454] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:19 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:19.829160 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-92d2f74c-74a5-43e6-bcce-1ef8744af238 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:19.829895 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-92d2f74c-74a5-43e6-bcce-1ef8744af238 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:19.836562 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-92d2f74c-74a5-43e6-bcce-1ef8744af238 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:19.837083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-92d2f74c-74a5-43e6-bcce-1ef8744af238 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:19.838004 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-92d2f74c-74a5-43e6-bcce-1ef8744af238 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:19.838540 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-92d2f74c-74a5-43e6-bcce-1ef8744af238 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:19.972704 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-92d2f74c-74a5-43e6-bcce-1ef8744af238 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:19.980287 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-92d2f74c-74a5-43e6-bcce-1ef8744af238 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1314 microversion: 2.1 time: 0.155865 Jun 07 13:16:19.980850 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 228/455] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:19 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:20.777084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-cbcc79d9-ad71-4a2b-9b1c-b0c4e89ea924 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:20.777684 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-cbcc79d9-ad71-4a2b-9b1c-b0c4e89ea924 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:20.784344 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cbcc79d9-ad71-4a2b-9b1c-b0c4e89ea924 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:20.785048 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cbcc79d9-ad71-4a2b-9b1c-b0c4e89ea924 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:20.785809 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cbcc79d9-ad71-4a2b-9b1c-b0c4e89ea924 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:20.786242 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cbcc79d9-ad71-4a2b-9b1c-b0c4e89ea924 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:20.915295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cbcc79d9-ad71-4a2b-9b1c-b0c4e89ea924 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:20.926309 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-cbcc79d9-ad71-4a2b-9b1c-b0c4e89ea924 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.152911 Jun 07 13:16:20.927213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 228/456] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:20 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:20.996867 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7656c539-738f-46d9-9d9b-f774c40f1ebf tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:20.997483 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7656c539-738f-46d9-9d9b-f774c40f1ebf tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:21.003905 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7656c539-738f-46d9-9d9b-f774c40f1ebf tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:21.004359 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7656c539-738f-46d9-9d9b-f774c40f1ebf tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:21.005122 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7656c539-738f-46d9-9d9b-f774c40f1ebf tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:21.005560 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7656c539-738f-46d9-9d9b-f774c40f1ebf tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:21.129036 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7656c539-738f-46d9-9d9b-f774c40f1ebf tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:21.136382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7656c539-738f-46d9-9d9b-f774c40f1ebf tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1314 microversion: 2.1 time: 0.143342 Jun 07 13:16:21.136953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 229/457] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:20 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:21.943832 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-827a5019-2793-4815-a6da-d81c2123cfab tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:21.944445 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-827a5019-2793-4815-a6da-d81c2123cfab tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:21.946281 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=64 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:21.951596 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-827a5019-2793-4815-a6da-d81c2123cfab tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:21.952048 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-827a5019-2793-4815-a6da-d81c2123cfab tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:21.952826 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-827a5019-2793-4815-a6da-d81c2123cfab tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:21.953262 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-827a5019-2793-4815-a6da-d81c2123cfab tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:22.081036 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-827a5019-2793-4815-a6da-d81c2123cfab tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:22.088576 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-827a5019-2793-4815-a6da-d81c2123cfab tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.148571 Jun 07 13:16:22.089079 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 229/458] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:21 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:22.153393 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6300fcca-99a7-4b3a-b37d-57c2707f3f23 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:22.154007 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6300fcca-99a7-4b3a-b37d-57c2707f3f23 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:22.161122 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6300fcca-99a7-4b3a-b37d-57c2707f3f23 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:22.161570 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6300fcca-99a7-4b3a-b37d-57c2707f3f23 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:22.162326 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6300fcca-99a7-4b3a-b37d-57c2707f3f23 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:22.162794 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6300fcca-99a7-4b3a-b37d-57c2707f3f23 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:22.293812 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6300fcca-99a7-4b3a-b37d-57c2707f3f23 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:22.301178 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6300fcca-99a7-4b3a-b37d-57c2707f3f23 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1314 microversion: 2.1 time: 0.151625 Jun 07 13:16:22.301747 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 230/459] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:22 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:23.105480 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9760104a-c1c5-4054-a816-98a1e927d714 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:23.106200 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9760104a-c1c5-4054-a816-98a1e927d714 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:23.112715 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9760104a-c1c5-4054-a816-98a1e927d714 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:23.113165 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9760104a-c1c5-4054-a816-98a1e927d714 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:23.113923 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9760104a-c1c5-4054-a816-98a1e927d714 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:23.114356 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9760104a-c1c5-4054-a816-98a1e927d714 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:23.250748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9760104a-c1c5-4054-a816-98a1e927d714 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:23.258190 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9760104a-c1c5-4054-a816-98a1e927d714 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1522 microversion: 2.1 time: 0.156545 Jun 07 13:16:23.258711 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 230/460] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:23 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:23.318129 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1d77145b-be41-4ea4-a8c5-907a7bef7b83 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:23.318786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1d77145b-be41-4ea4-a8c5-907a7bef7b83 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:23.325216 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1d77145b-be41-4ea4-a8c5-907a7bef7b83 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:23.325665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1d77145b-be41-4ea4-a8c5-907a7bef7b83 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:23.326476 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1d77145b-be41-4ea4-a8c5-907a7bef7b83 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:23.326918 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1d77145b-be41-4ea4-a8c5-907a7bef7b83 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:23.452057 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1d77145b-be41-4ea4-a8c5-907a7bef7b83 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:23.459911 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1d77145b-be41-4ea4-a8c5-907a7bef7b83 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1314 microversion: 2.1 time: 0.145564 Jun 07 13:16:23.460480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 231/461] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:23 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:24.274779 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0a507387-e11d-4f6a-bfd6-1fc4371fcdd1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:24.275416 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0a507387-e11d-4f6a-bfd6-1fc4371fcdd1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:24.282379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0a507387-e11d-4f6a-bfd6-1fc4371fcdd1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:24.282857 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0a507387-e11d-4f6a-bfd6-1fc4371fcdd1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:24.283615 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0a507387-e11d-4f6a-bfd6-1fc4371fcdd1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:24.284054 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0a507387-e11d-4f6a-bfd6-1fc4371fcdd1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:24.412081 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0a507387-e11d-4f6a-bfd6-1fc4371fcdd1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:24.419463 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0a507387-e11d-4f6a-bfd6-1fc4371fcdd1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1502 microversion: 2.1 time: 0.148517 Jun 07 13:16:24.420033 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 231/462] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:24 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:24.435725 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cca9b491-f907-4cf7-9689-92f163429c30 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:24.436464 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cca9b491-f907-4cf7-9689-92f163429c30 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:24.443014 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cca9b491-f907-4cf7-9689-92f163429c30 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:24.443465 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cca9b491-f907-4cf7-9689-92f163429c30 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:24.444258 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cca9b491-f907-4cf7-9689-92f163429c30 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:24.444696 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cca9b491-f907-4cf7-9689-92f163429c30 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:24.476225 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1d499472-6260-42c9-a742-beb62d997088 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:24.476833 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1d499472-6260-42c9-a742-beb62d997088 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:24.482840 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1d499472-6260-42c9-a742-beb62d997088 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:24.483285 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1d499472-6260-42c9-a742-beb62d997088 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:24.484084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1d499472-6260-42c9-a742-beb62d997088 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:24.484591 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1d499472-6260-42c9-a742-beb62d997088 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:24.573843 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cca9b491-f907-4cf7-9689-92f163429c30 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:24.581879 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cca9b491-f907-4cf7-9689-92f163429c30 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1515 microversion: 2.1 time: 0.149933 Jun 07 13:16:24.582614 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 232/463] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:24 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:24.614246 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1d499472-6260-42c9-a742-beb62d997088 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:24.621878 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1d499472-6260-42c9-a742-beb62d997088 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1496 microversion: 2.1 time: 0.149464 Jun 07 13:16:24.622533 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 232/464] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:24 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1496 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:16:25.334282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-906e1ffd-df1e-41a3-83e4-5fff7996f311 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:25.334826 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-906e1ffd-df1e-41a3-83e4-5fff7996f311 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:25.340890 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-906e1ffd-df1e-41a3-83e4-5fff7996f311 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:25.341336 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-906e1ffd-df1e-41a3-83e4-5fff7996f311 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:25.342093 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-906e1ffd-df1e-41a3-83e4-5fff7996f311 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:25.342555 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-906e1ffd-df1e-41a3-83e4-5fff7996f311 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:25.366938 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-906e1ffd-df1e-41a3-83e4-5fff7996f311 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:16:25.441900 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-906e1ffd-df1e-41a3-83e4-5fff7996f311 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "DELETE /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 204 len: 0 microversion: 2.1 time: 0.110901 Jun 07 13:16:25.442794 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 233/465] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:16:25 2022] DELETE /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 13:16:25.450938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d0f56fd3-4461-41ca-8087-2ad64e67fee8 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:25.451553 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d0f56fd3-4461-41ca-8087-2ad64e67fee8 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:25.457326 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d0f56fd3-4461-41ca-8087-2ad64e67fee8 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:25.457778 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d0f56fd3-4461-41ca-8087-2ad64e67fee8 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:25.458570 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d0f56fd3-4461-41ca-8087-2ad64e67fee8 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:25.459003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d0f56fd3-4461-41ca-8087-2ad64e67fee8 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:25.582080 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d0f56fd3-4461-41ca-8087-2ad64e67fee8 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:25.589407 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d0f56fd3-4461-41ca-8087-2ad64e67fee8 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1502 microversion: 2.1 time: 0.142199 Jun 07 13:16:25.589971 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 233/466] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:25 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1502 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:26.607574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fb82fe54-ab4c-43d4-ad0f-3be2bf7d9e39 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:26.608279 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fb82fe54-ab4c-43d4-ad0f-3be2bf7d9e39 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:26.614685 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb82fe54-ab4c-43d4-ad0f-3be2bf7d9e39 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:26.615141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb82fe54-ab4c-43d4-ad0f-3be2bf7d9e39 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:26.615902 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb82fe54-ab4c-43d4-ad0f-3be2bf7d9e39 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:26.616343 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb82fe54-ab4c-43d4-ad0f-3be2bf7d9e39 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:26.745171 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fb82fe54-ab4c-43d4-ad0f-3be2bf7d9e39 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:26.753271 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fb82fe54-ab4c-43d4-ad0f-3be2bf7d9e39 tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1502 microversion: 2.1 time: 0.149902 Jun 07 13:16:26.753830 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 234/467] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:26 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:27.022941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d612a348-74dd-47f1-be83-846b35807b13 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:27.023894 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d612a348-74dd-47f1-be83-846b35807b13 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:27.029861 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d612a348-74dd-47f1-be83-846b35807b13 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:27.030310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d612a348-74dd-47f1-be83-846b35807b13 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:27.031776 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d612a348-74dd-47f1-be83-846b35807b13 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:27.032211 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d612a348-74dd-47f1-be83-846b35807b13 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:27.054316 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-d612a348-74dd-47f1-be83-846b35807b13 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lazy-loading 'flavor' on Instance uuid 972b9306-4700-4212-ba99-0654d90e4348 {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:16:27.132085 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:27.163777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d612a348-74dd-47f1-be83-846b35807b13 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "POST /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348/action" status: 200 len: 32 microversion: 2.1 time: 0.144581 Jun 07 13:16:27.164306 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 234/468] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jun 7 13:16:27 2022] POST /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348/action => generated 32 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:16:27.173212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b5327851-7d1a-4025-a716-1fa4e0911bcf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:27.173843 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b5327851-7d1a-4025-a716-1fa4e0911bcf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:27.175886 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:27.181165 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b5327851-7d1a-4025-a716-1fa4e0911bcf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:27.181612 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b5327851-7d1a-4025-a716-1fa4e0911bcf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:27.182371 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b5327851-7d1a-4025-a716-1fa4e0911bcf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:27.182832 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b5327851-7d1a-4025-a716-1fa4e0911bcf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:27.477467 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b5327851-7d1a-4025-a716-1fa4e0911bcf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:27.484482 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b5327851-7d1a-4025-a716-1fa4e0911bcf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.314600 Jun 07 13:16:27.486477 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 235/469] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:27 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:27.771049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9f1068fa-d472-4909-993e-79e4b4d6b04f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:27.771747 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9f1068fa-d472-4909-993e-79e4b4d6b04f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:27.777896 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9f1068fa-d472-4909-993e-79e4b4d6b04f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:27.778341 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9f1068fa-d472-4909-993e-79e4b4d6b04f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:27.779138 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9f1068fa-d472-4909-993e-79e4b4d6b04f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:27.779573 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9f1068fa-d472-4909-993e-79e4b4d6b04f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:27.921159 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9f1068fa-d472-4909-993e-79e4b4d6b04f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22938ce89cd04ba79c0f851298adfb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da750b8c0fae4e4695f1f511c408a389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:27.930002 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9f1068fa-d472-4909-993e-79e4b4d6b04f tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 200 len: 1502 microversion: 2.1 time: 0.163441 Jun 07 13:16:27.930611 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 235/470] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:27 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:28.119793 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-8856a6a8-80f7-49df-bba9-d16a4302e85f req-c9c8e840-1bb9-4ea8-b421-b610ecadbd25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873b7b4d-d379-41e9-b25f-17da66307b4a", "name": "network-vif-deleted", "tag": "47faff83-87c7-4369-915c-03dec9101dfc"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:28.130177 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-8856a6a8-80f7-49df-bba9-d16a4302e85f req-c9c8e840-1bb9-4ea8-b421-b610ecadbd25 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:28.131108 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-8856a6a8-80f7-49df-bba9-d16a4302e85f req-c9c8e840-1bb9-4ea8-b421-b610ecadbd25 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:28.142848 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-8856a6a8-80f7-49df-bba9-d16a4302e85f req-c9c8e840-1bb9-4ea8-b421-b610ecadbd25 service nova] Creating event network-vif-deleted:47faff83-87c7-4369-915c-03dec9101dfc for instance 873b7b4d-d379-41e9-b25f-17da66307b4a on hv-cinder-84496 Jun 07 13:16:28.147786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-8856a6a8-80f7-49df-bba9-d16a4302e85f req-c9c8e840-1bb9-4ea8-b421-b610ecadbd25 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031927 Jun 07 13:16:28.148932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 236/471] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:16:28.405205 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-15fc8c96-885f-4747-bb99-0fb30f74aa89 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1480767887", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1885072570", "security_groups": [{"name": "tempest-secgroup-smoke-1463953327"}], "networks": [{"uuid": "e5c266ae-2813-458a-8957-712372926d90"}], "block_device_mapping_v2": [{"uuid": "a2816efa-c8ba-4527-a3e3-6f78a095b540", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:28.501547 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8a22d6bb-d0b4-43b9-acef-35aebc913bad tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:28.502190 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8a22d6bb-d0b4-43b9-acef-35aebc913bad tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:28.508209 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a22d6bb-d0b4-43b9-acef-35aebc913bad tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:28.508649 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a22d6bb-d0b4-43b9-acef-35aebc913bad tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:28.509394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a22d6bb-d0b4-43b9-acef-35aebc913bad tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:28.509822 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a22d6bb-d0b4-43b9-acef-35aebc913bad tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:28.512717 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.network.neutron [None req-15fc8c96-885f-4747-bb99-0fb30f74aa89 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] validate_networks() for [('e5c266ae-2813-458a-8957-712372926d90', None, None, None, None, None)] {{(pid=117797) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:16:28.637972 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8a22d6bb-d0b4-43b9-acef-35aebc913bad tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:28.646743 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8a22d6bb-d0b4-43b9-acef-35aebc913bad tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.149357 Jun 07 13:16:28.647366 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 237/472] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:28 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:16:28.885912 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-15fc8c96-885f-4747-bb99-0fb30f74aa89 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Flavor limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:16:28.886337 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-15fc8c96-885f-4747-bb99-0fb30f74aa89 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Image limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:16:28.886918 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-15fc8c96-885f-4747-bb99-0fb30f74aa89 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Flavor pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:16:28.887325 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-15fc8c96-885f-4747-bb99-0fb30f74aa89 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Image pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:16:28.887846 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-15fc8c96-885f-4747-bb99-0fb30f74aa89 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:16:28.901757 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-15fc8c96-885f-4747-bb99-0fb30f74aa89 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:28.902218 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-15fc8c96-885f-4747-bb99-0fb30f74aa89 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:28.903057 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-15fc8c96-885f-4747-bb99-0fb30f74aa89 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:28.903572 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-15fc8c96-885f-4747-bb99-0fb30f74aa89 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:28.923487 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-15fc8c96-885f-4747-bb99-0fb30f74aa89 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Getting quotas for project 992f495f37114f4c846ec55f37d7afd6. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:16:28.927961 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-15fc8c96-885f-4747-bb99-0fb30f74aa89 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Getting quotas for user 906a40d3ab884e93a32cfca83204d34f and project 992f495f37114f4c846ec55f37d7afd6. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:16:28.947403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4c993d14-ad78-4a62-b382-6c63e6006dfd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:28.948017 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4c993d14-ad78-4a62-b382-6c63e6006dfd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] [instance: 873b7b4d-d379-41e9-b25f-17da66307b4a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:28.954576 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c993d14-ad78-4a62-b382-6c63e6006dfd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:28.955029 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c993d14-ad78-4a62-b382-6c63e6006dfd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:28.955963 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c993d14-ad78-4a62-b382-6c63e6006dfd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:28.956405 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c993d14-ad78-4a62-b382-6c63e6006dfd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:28.972565 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-4c993d14-ad78-4a62-b382-6c63e6006dfd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] HTTP exception thrown: Instance 873b7b4d-d379-41e9-b25f-17da66307b4a could not be found. Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4c993d14-ad78-4a62-b382-6c63e6006dfd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Request method failure captured: Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a HTTP/1.1 Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin09ySYjqlUfCcbM0B2FC7q9kM5v0NDFFwKy2W_jzv-kECAPuj0yHqV7MHr5Khf04fiLe3SSODjdeavP1k3-SESuWHawj9ykyl6VrTFcnV9jHnESVua6bFDO9AoNMAR2C4JQe6dTxFzSjpkXC9_FOz70-l2Tr-KcXxzrhmXHiztN7jeQ Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: da750b8c0fae4e4695f1f511c408a389 Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-VolumesActionsTest-1355306392 Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:16:28.974552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:16:28.976141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_da750b8c0fae4e4695f1f511c408a389", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/da750b8c0fae4e4695f1f511c408a389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da750b8c0fae4e4695f1f511c408a389"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da750b8c0fae4e4695f1f511c408a389"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:16:28.976141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-VolumesActionsTest-1355306392 Jun 07 13:16:28.976141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: da750b8c0fae4e4695f1f511c408a389 Jun 07 13:16:28.976141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-VolumesActionsTest-1355306392 Jun 07 13:16:28.976141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-VolumesActionsTest-1355306392-project Jun 07 13:16:28.976141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:16:28.976141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:16:28.976141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 22938ce89cd04ba79c0f851298adfb0f Jun 07 13:16:28.976141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-VolumesActionsTest-1355306392-project Jun 07 13:16:28.976141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:16:28.976141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance 873b7b4d-d379-41e9-b25f-17da66307b4a could not be found. Jun 07 13:16:28.976141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': '873b7b4d-d379-41e9-b25f-17da66307b4a'} Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 873b7b4d-d379-41e9-b25f-17da66307b4a could not be found. Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:16:28.977042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 873b7b4d-d379-41e9-b25f-17da66307b4a could not be found. Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 873b7b4d-d379-41e9-b25f-17da66307b4a could not be found. Jun 07 13:16:28.978487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:16:28.979731 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4c993d14-ad78-4a62-b382-6c63e6006dfd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] Returning 404 to user: Instance 873b7b4d-d379-41e9-b25f-17da66307b4a could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:16:28.979731 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4c993d14-ad78-4a62-b382-6c63e6006dfd tempest-VolumesActionsTest-1355306392 tempest-VolumesActionsTest-1355306392-project] 10.222.0.58 "GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a" status: 404 len: 111 microversion: 2.1 time: 0.032780 Jun 07 13:16:28.979731 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 238/473] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:28 2022] GET /compute/v2.1/servers/873b7b4d-d379-41e9-b25f-17da66307b4a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:16:28.996259 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-15fc8c96-885f-4747-bb99-0fb30f74aa89 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Going to run 1 instances... {{(pid=117797) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:16:28.998339 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-15fc8c96-885f-4747-bb99-0fb30f74aa89 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a2816efa-c8ba-4527-a3e3-6f78a095b540',volume_size=None,volume_type=None)] {{(pid=117797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:16:29.138799 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-15fc8c96-885f-4747-bb99-0fb30f74aa89 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.737378 Jun 07 13:16:29.139437 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 236/474] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:16:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:16:29.150159 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b28a5fd5-5640-49e6-9e38-3fe4f44fb37f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:29.150948 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b28a5fd5-5640-49e6-9e38-3fe4f44fb37f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:29.213639 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b28a5fd5-5640-49e6-9e38-3fe4f44fb37f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:29.221356 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b28a5fd5-5640-49e6-9e38-3fe4f44fb37f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1089 microversion: 2.1 time: 0.074962 Jun 07 13:16:29.221918 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 239/475] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:29 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:29.664140 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0c2ad871-b740-4021-87c6-bc965be3de9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:29.665013 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0c2ad871-b740-4021-87c6-bc965be3de9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:29.671492 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0c2ad871-b740-4021-87c6-bc965be3de9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:29.671943 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0c2ad871-b740-4021-87c6-bc965be3de9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:29.672726 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0c2ad871-b740-4021-87c6-bc965be3de9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:29.673164 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0c2ad871-b740-4021-87c6-bc965be3de9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:29.814321 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0c2ad871-b740-4021-87c6-bc965be3de9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:29.821731 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0c2ad871-b740-4021-87c6-bc965be3de9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.161943 Jun 07 13:16:29.822238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 237/476] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:29 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:30.239000 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a4267100-b957-4b67-ac0b-316539f01700 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:30.239784 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a4267100-b957-4b67-ac0b-316539f01700 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:30.248041 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a4267100-b957-4b67-ac0b-316539f01700 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:30.248493 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a4267100-b957-4b67-ac0b-316539f01700 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:30.249276 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a4267100-b957-4b67-ac0b-316539f01700 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:30.249748 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a4267100-b957-4b67-ac0b-316539f01700 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:30.325786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a4267100-b957-4b67-ac0b-316539f01700 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:30.333688 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a4267100-b957-4b67-ac0b-316539f01700 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1195 microversion: 2.1 time: 0.098540 Jun 07 13:16:30.334258 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 240/477] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:30 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1195 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:30.838416 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-195ab4dc-63ce-4398-b152-6f4e712e9f04 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:30.839044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-195ab4dc-63ce-4398-b152-6f4e712e9f04 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:30.845054 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-195ab4dc-63ce-4398-b152-6f4e712e9f04 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:30.845498 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-195ab4dc-63ce-4398-b152-6f4e712e9f04 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:30.846242 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-195ab4dc-63ce-4398-b152-6f4e712e9f04 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:30.846702 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-195ab4dc-63ce-4398-b152-6f4e712e9f04 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:30.972498 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-195ab4dc-63ce-4398-b152-6f4e712e9f04 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:30.979855 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-195ab4dc-63ce-4398-b152-6f4e712e9f04 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.145259 Jun 07 13:16:30.980409 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 238/478] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:30 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:31.351701 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c5bd1bf1-4e65-4a49-a4d9-800c29ebd31f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:31.352335 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c5bd1bf1-4e65-4a49-a4d9-800c29ebd31f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:31.358722 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c5bd1bf1-4e65-4a49-a4d9-800c29ebd31f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:31.359685 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c5bd1bf1-4e65-4a49-a4d9-800c29ebd31f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:31.360441 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c5bd1bf1-4e65-4a49-a4d9-800c29ebd31f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:31.360873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c5bd1bf1-4e65-4a49-a4d9-800c29ebd31f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:31.423251 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c5bd1bf1-4e65-4a49-a4d9-800c29ebd31f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:31.430567 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c5bd1bf1-4e65-4a49-a4d9-800c29ebd31f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1205 microversion: 2.1 time: 0.082721 Jun 07 13:16:31.431122 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 241/479] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:31 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1205 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:31.996407 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c5dac2d5-af8e-4816-803a-f65aaec53fb3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:31.997022 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c5dac2d5-af8e-4816-803a-f65aaec53fb3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:32.003162 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c5dac2d5-af8e-4816-803a-f65aaec53fb3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:32.003917 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c5dac2d5-af8e-4816-803a-f65aaec53fb3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:32.004697 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c5dac2d5-af8e-4816-803a-f65aaec53fb3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:32.005134 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c5dac2d5-af8e-4816-803a-f65aaec53fb3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:32.136848 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c5dac2d5-af8e-4816-803a-f65aaec53fb3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:32.144709 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c5dac2d5-af8e-4816-803a-f65aaec53fb3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.152288 Jun 07 13:16:32.145275 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 239/480] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:31 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:32.448024 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5333bd22-3c81-4dfb-bd33-9d1e392650fc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:32.448628 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5333bd22-3c81-4dfb-bd33-9d1e392650fc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:32.455721 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5333bd22-3c81-4dfb-bd33-9d1e392650fc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:32.456166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5333bd22-3c81-4dfb-bd33-9d1e392650fc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:32.456908 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5333bd22-3c81-4dfb-bd33-9d1e392650fc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:32.457336 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5333bd22-3c81-4dfb-bd33-9d1e392650fc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:32.459955 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:32.517860 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5333bd22-3c81-4dfb-bd33-9d1e392650fc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:32.525170 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5333bd22-3c81-4dfb-bd33-9d1e392650fc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1205 microversion: 2.1 time: 0.080957 Jun 07 13:16:32.525717 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 242/481] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:32 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1205 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:33.161510 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b41d0ffc-d31c-4964-aeed-9866976e3887 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:33.162118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b41d0ffc-d31c-4964-aeed-9866976e3887 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:33.168064 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b41d0ffc-d31c-4964-aeed-9866976e3887 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:33.168509 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b41d0ffc-d31c-4964-aeed-9866976e3887 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:33.169285 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b41d0ffc-d31c-4964-aeed-9866976e3887 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:33.169716 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b41d0ffc-d31c-4964-aeed-9866976e3887 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:33.294568 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b41d0ffc-d31c-4964-aeed-9866976e3887 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:33.301951 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b41d0ffc-d31c-4964-aeed-9866976e3887 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.144504 Jun 07 13:16:33.307049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 240/482] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:33 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:33.541216 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-29b30626-7bdf-4ddd-8194-54eb4a123af3 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:33.541850 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-29b30626-7bdf-4ddd-8194-54eb4a123af3 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:33.548743 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-29b30626-7bdf-4ddd-8194-54eb4a123af3 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:33.549183 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-29b30626-7bdf-4ddd-8194-54eb4a123af3 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:33.549929 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-29b30626-7bdf-4ddd-8194-54eb4a123af3 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:33.550357 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-29b30626-7bdf-4ddd-8194-54eb4a123af3 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:33.607949 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-29b30626-7bdf-4ddd-8194-54eb4a123af3 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:33.615651 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-29b30626-7bdf-4ddd-8194-54eb4a123af3 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1205 microversion: 2.1 time: 0.078293 Jun 07 13:16:33.616214 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 243/483] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:33 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1205 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:34.318241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-cdb2f170-e7a1-4822-9e7e-993825e32029 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:34.318873 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-cdb2f170-e7a1-4822-9e7e-993825e32029 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:34.325258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cdb2f170-e7a1-4822-9e7e-993825e32029 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:34.325712 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cdb2f170-e7a1-4822-9e7e-993825e32029 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:34.326514 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cdb2f170-e7a1-4822-9e7e-993825e32029 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:34.326955 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cdb2f170-e7a1-4822-9e7e-993825e32029 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:34.458086 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cdb2f170-e7a1-4822-9e7e-993825e32029 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:34.465982 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-cdb2f170-e7a1-4822-9e7e-993825e32029 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.151512 Jun 07 13:16:34.466574 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 241/484] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:34 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:34.633107 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-24633a3a-c874-4cdb-9005-dbf72154b642 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:34.633698 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-24633a3a-c874-4cdb-9005-dbf72154b642 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:34.641145 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-24633a3a-c874-4cdb-9005-dbf72154b642 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:34.641593 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-24633a3a-c874-4cdb-9005-dbf72154b642 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:34.642371 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-24633a3a-c874-4cdb-9005-dbf72154b642 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:34.642825 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-24633a3a-c874-4cdb-9005-dbf72154b642 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:34.862868 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-24633a3a-c874-4cdb-9005-dbf72154b642 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:34.870613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-24633a3a-c874-4cdb-9005-dbf72154b642 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1273 microversion: 2.1 time: 0.241269 Jun 07 13:16:34.871158 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 244/485] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:34 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:35.483098 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3b677750-1478-4f28-971e-3757af69e277 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:35.484839 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3b677750-1478-4f28-971e-3757af69e277 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:35.491331 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3b677750-1478-4f28-971e-3757af69e277 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:35.492035 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3b677750-1478-4f28-971e-3757af69e277 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:35.492808 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3b677750-1478-4f28-971e-3757af69e277 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:35.493326 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3b677750-1478-4f28-971e-3757af69e277 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:35.579253 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-07753cca-f189-4a8e-80c7-4aef399a813a req-13f8014f-3ac7-4d26-ab19-4c747860cdfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25e18880-cb5c-4346-9a43-a861b07f27a8", "tag": "d0c830a1-4526-4f25-a02e-0ee9838a85ba"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:35.587671 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-07753cca-f189-4a8e-80c7-4aef399a813a req-13f8014f-3ac7-4d26-ab19-4c747860cdfc service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:35.588181 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-07753cca-f189-4a8e-80c7-4aef399a813a req-13f8014f-3ac7-4d26-ab19-4c747860cdfc service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:35.601839 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-07753cca-f189-4a8e-80c7-4aef399a813a req-13f8014f-3ac7-4d26-ab19-4c747860cdfc service nova] Creating event network-changed:d0c830a1-4526-4f25-a02e-0ee9838a85ba for instance 25e18880-cb5c-4346-9a43-a861b07f27a8 on hv-cinder-84496 Jun 07 13:16:35.607404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-07753cca-f189-4a8e-80c7-4aef399a813a req-13f8014f-3ac7-4d26-ab19-4c747860cdfc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031615 Jun 07 13:16:35.608246 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 245/486] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:16:35.669761 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3b677750-1478-4f28-971e-3757af69e277 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:35.679804 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3b677750-1478-4f28-971e-3757af69e277 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.200589 Jun 07 13:16:35.683880 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 242/487] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:35 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:35.891058 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c732a302-74db-4c16-89b1-e1dec9cc13ac tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:35.891957 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c732a302-74db-4c16-89b1-e1dec9cc13ac tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:35.899849 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c732a302-74db-4c16-89b1-e1dec9cc13ac tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:35.900368 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c732a302-74db-4c16-89b1-e1dec9cc13ac tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:35.901214 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c732a302-74db-4c16-89b1-e1dec9cc13ac tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:35.901723 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c732a302-74db-4c16-89b1-e1dec9cc13ac tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:36.137307 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c732a302-74db-4c16-89b1-e1dec9cc13ac tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:36.146808 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c732a302-74db-4c16-89b1-e1dec9cc13ac tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1273 microversion: 2.1 time: 0.262003 Jun 07 13:16:36.154808 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 246/488] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:35 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:36.700710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-684d8ef9-ce2e-4b32-9810-e9e4c852518a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:36.702159 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-684d8ef9-ce2e-4b32-9810-e9e4c852518a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:36.709128 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-684d8ef9-ce2e-4b32-9810-e9e4c852518a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:36.709807 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-684d8ef9-ce2e-4b32-9810-e9e4c852518a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:36.710795 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-684d8ef9-ce2e-4b32-9810-e9e4c852518a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:36.711389 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-684d8ef9-ce2e-4b32-9810-e9e4c852518a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:36.972133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-684d8ef9-ce2e-4b32-9810-e9e4c852518a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:36.986179 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-684d8ef9-ce2e-4b32-9810-e9e4c852518a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.289385 Jun 07 13:16:36.998992 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 243/489] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:36 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:37.164218 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-19b4a9cb-a872-4037-8a34-edfde8cffb39 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:37.165619 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-19b4a9cb-a872-4037-8a34-edfde8cffb39 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:37.177476 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-19b4a9cb-a872-4037-8a34-edfde8cffb39 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:37.179151 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-19b4a9cb-a872-4037-8a34-edfde8cffb39 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:37.180416 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-19b4a9cb-a872-4037-8a34-edfde8cffb39 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:37.181035 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-19b4a9cb-a872-4037-8a34-edfde8cffb39 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:37.344604 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-19b4a9cb-a872-4037-8a34-edfde8cffb39 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:37.353077 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-19b4a9cb-a872-4037-8a34-edfde8cffb39 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1261 microversion: 2.1 time: 0.193027 Jun 07 13:16:37.355272 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 247/490] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:37 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1261 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:16:38.007733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8904d0e8-c8bc-4daa-833c-f0514346b26c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:38.010275 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8904d0e8-c8bc-4daa-833c-f0514346b26c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:38.020550 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8904d0e8-c8bc-4daa-833c-f0514346b26c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:38.024496 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8904d0e8-c8bc-4daa-833c-f0514346b26c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:38.025534 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8904d0e8-c8bc-4daa-833c-f0514346b26c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:38.027759 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8904d0e8-c8bc-4daa-833c-f0514346b26c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:38.230054 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8904d0e8-c8bc-4daa-833c-f0514346b26c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:38.243984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8904d0e8-c8bc-4daa-833c-f0514346b26c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.241857 Jun 07 13:16:38.255373 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 244/491] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:38 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:38.375732 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-aff58e07-0b16-4752-b742-9dd298724cd1 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:38.376361 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-aff58e07-0b16-4752-b742-9dd298724cd1 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:38.384038 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aff58e07-0b16-4752-b742-9dd298724cd1 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:38.384853 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aff58e07-0b16-4752-b742-9dd298724cd1 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:38.386257 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aff58e07-0b16-4752-b742-9dd298724cd1 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:38.387650 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aff58e07-0b16-4752-b742-9dd298724cd1 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:38.579022 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-aff58e07-0b16-4752-b742-9dd298724cd1 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:38.587228 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-aff58e07-0b16-4752-b742-9dd298724cd1 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1261 microversion: 2.1 time: 0.218649 Jun 07 13:16:38.588733 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 248/492] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:38 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1261 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:39.262573 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c654d4d3-74bd-46c0-adda-f2575208c585 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:39.263697 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c654d4d3-74bd-46c0-adda-f2575208c585 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:39.266207 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=2 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:39.269348 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=6 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:39.275086 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c654d4d3-74bd-46c0-adda-f2575208c585 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:39.276282 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c654d4d3-74bd-46c0-adda-f2575208c585 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:39.277278 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c654d4d3-74bd-46c0-adda-f2575208c585 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:39.278182 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c654d4d3-74bd-46c0-adda-f2575208c585 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:39.442823 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c654d4d3-74bd-46c0-adda-f2575208c585 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:39.453631 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c654d4d3-74bd-46c0-adda-f2575208c585 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.194793 Jun 07 13:16:39.458376 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 245/493] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:39 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:39.606492 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-928dd454-793a-4d0f-a1a1-71f21967b653 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:39.607471 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-928dd454-793a-4d0f-a1a1-71f21967b653 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:39.610239 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:39.616690 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-928dd454-793a-4d0f-a1a1-71f21967b653 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:39.617354 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-928dd454-793a-4d0f-a1a1-71f21967b653 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:39.618314 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-928dd454-793a-4d0f-a1a1-71f21967b653 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:39.618921 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-928dd454-793a-4d0f-a1a1-71f21967b653 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:39.772952 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-928dd454-793a-4d0f-a1a1-71f21967b653 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:39.783114 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-928dd454-793a-4d0f-a1a1-71f21967b653 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1261 microversion: 2.1 time: 0.181653 Jun 07 13:16:39.783824 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 249/494] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:39 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:16:40.475009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-37f6ba2b-b749-48b7-ab34-97de49d5c638 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:40.475619 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-37f6ba2b-b749-48b7-ab34-97de49d5c638 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:40.481627 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-37f6ba2b-b749-48b7-ab34-97de49d5c638 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:40.482076 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-37f6ba2b-b749-48b7-ab34-97de49d5c638 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:40.482858 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-37f6ba2b-b749-48b7-ab34-97de49d5c638 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:40.483294 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-37f6ba2b-b749-48b7-ab34-97de49d5c638 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:40.611931 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-37f6ba2b-b749-48b7-ab34-97de49d5c638 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:40.619751 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-37f6ba2b-b749-48b7-ab34-97de49d5c638 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.148537 Jun 07 13:16:40.620426 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 246/495] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:40 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:40.800243 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f26a2b43-4ebc-4aba-b550-2cdb1426edfc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:40.801466 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f26a2b43-4ebc-4aba-b550-2cdb1426edfc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:40.808031 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f26a2b43-4ebc-4aba-b550-2cdb1426edfc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:40.808481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f26a2b43-4ebc-4aba-b550-2cdb1426edfc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:40.809290 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f26a2b43-4ebc-4aba-b550-2cdb1426edfc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:40.810064 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f26a2b43-4ebc-4aba-b550-2cdb1426edfc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:40.951781 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f26a2b43-4ebc-4aba-b550-2cdb1426edfc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:40.960517 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f26a2b43-4ebc-4aba-b550-2cdb1426edfc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1261 microversion: 2.1 time: 0.164573 Jun 07 13:16:40.961379 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 250/496] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:40 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:16:41.636772 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-52127fdb-9336-4917-b09b-b32c9b9c1f4b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:41.637461 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-52127fdb-9336-4917-b09b-b32c9b9c1f4b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:41.643401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-52127fdb-9336-4917-b09b-b32c9b9c1f4b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:41.643884 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-52127fdb-9336-4917-b09b-b32c9b9c1f4b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:41.644752 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-52127fdb-9336-4917-b09b-b32c9b9c1f4b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:41.645181 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-52127fdb-9336-4917-b09b-b32c9b9c1f4b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:41.786082 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-52127fdb-9336-4917-b09b-b32c9b9c1f4b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:41.793488 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-52127fdb-9336-4917-b09b-b32c9b9c1f4b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.160592 Jun 07 13:16:41.794246 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 247/497] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:41 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:41.977593 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a7e30cd6-c73f-452f-b090-70bb748f1639 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:41.978132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a7e30cd6-c73f-452f-b090-70bb748f1639 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:41.985405 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7e30cd6-c73f-452f-b090-70bb748f1639 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:41.985871 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7e30cd6-c73f-452f-b090-70bb748f1639 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:41.986712 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7e30cd6-c73f-452f-b090-70bb748f1639 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:41.987156 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7e30cd6-c73f-452f-b090-70bb748f1639 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:42.138749 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a7e30cd6-c73f-452f-b090-70bb748f1639 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:42.146627 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a7e30cd6-c73f-452f-b090-70bb748f1639 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1261 microversion: 2.1 time: 0.173075 Jun 07 13:16:42.147379 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 251/498] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:41 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:42.811054 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5c7ebdb5-61fb-47ba-b254-5d2cef77c6fc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:42.812906 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5c7ebdb5-61fb-47ba-b254-5d2cef77c6fc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:42.819778 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5c7ebdb5-61fb-47ba-b254-5d2cef77c6fc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:42.820223 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5c7ebdb5-61fb-47ba-b254-5d2cef77c6fc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:42.821034 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5c7ebdb5-61fb-47ba-b254-5d2cef77c6fc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:42.821475 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5c7ebdb5-61fb-47ba-b254-5d2cef77c6fc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:43.020491 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5c7ebdb5-61fb-47ba-b254-5d2cef77c6fc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:43.028607 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5c7ebdb5-61fb-47ba-b254-5d2cef77c6fc tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.221464 Jun 07 13:16:43.038355 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 248/499] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:42 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:43.165838 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-83166cff-d6c6-4e3c-9a42-f2904404ca06 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:43.167491 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-83166cff-d6c6-4e3c-9a42-f2904404ca06 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:43.175653 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-83166cff-d6c6-4e3c-9a42-f2904404ca06 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:43.177989 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-83166cff-d6c6-4e3c-9a42-f2904404ca06 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:43.180992 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-83166cff-d6c6-4e3c-9a42-f2904404ca06 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:43.182961 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-83166cff-d6c6-4e3c-9a42-f2904404ca06 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:43.408090 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-83166cff-d6c6-4e3c-9a42-f2904404ca06 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:43.416466 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-83166cff-d6c6-4e3c-9a42-f2904404ca06 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1261 microversion: 2.1 time: 0.255071 Jun 07 13:16:43.417264 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 252/500] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:43 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1261 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:44.046369 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-038704ca-19e8-4251-8ee9-680630df583b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:44.047549 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-038704ca-19e8-4251-8ee9-680630df583b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:44.054268 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-038704ca-19e8-4251-8ee9-680630df583b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:44.054816 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-038704ca-19e8-4251-8ee9-680630df583b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:44.055977 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-038704ca-19e8-4251-8ee9-680630df583b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:44.056513 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-038704ca-19e8-4251-8ee9-680630df583b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:44.252621 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-038704ca-19e8-4251-8ee9-680630df583b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:44.274811 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-038704ca-19e8-4251-8ee9-680630df583b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.232986 Jun 07 13:16:44.275396 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 249/501] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:44 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:44.435454 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-521abb01-c5bf-47e5-a9c3-c2098387b653 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:44.437253 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-521abb01-c5bf-47e5-a9c3-c2098387b653 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:44.444209 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-521abb01-c5bf-47e5-a9c3-c2098387b653 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:44.444871 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-521abb01-c5bf-47e5-a9c3-c2098387b653 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:44.445806 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-521abb01-c5bf-47e5-a9c3-c2098387b653 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:44.446234 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-521abb01-c5bf-47e5-a9c3-c2098387b653 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:44.665874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-521abb01-c5bf-47e5-a9c3-c2098387b653 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:44.675117 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-521abb01-c5bf-47e5-a9c3-c2098387b653 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1261 microversion: 2.1 time: 0.243422 Jun 07 13:16:44.684461 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 253/502] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:44 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1261 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:45.293016 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1c7c4935-4654-416b-ac43-3409388819f5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:45.294269 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1c7c4935-4654-416b-ac43-3409388819f5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:45.301751 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1c7c4935-4654-416b-ac43-3409388819f5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:45.302432 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1c7c4935-4654-416b-ac43-3409388819f5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:45.303528 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1c7c4935-4654-416b-ac43-3409388819f5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:45.304154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1c7c4935-4654-416b-ac43-3409388819f5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:45.504791 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1c7c4935-4654-416b-ac43-3409388819f5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:45.517948 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1c7c4935-4654-416b-ac43-3409388819f5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.228765 Jun 07 13:16:45.518485 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 250/503] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:45 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:45.696687 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b28e2c37-1d77-4764-a8f1-d1c5b5571af6 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:45.699475 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b28e2c37-1d77-4764-a8f1-d1c5b5571af6 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:45.719422 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b28e2c37-1d77-4764-a8f1-d1c5b5571af6 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:45.720774 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b28e2c37-1d77-4764-a8f1-d1c5b5571af6 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:45.722176 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b28e2c37-1d77-4764-a8f1-d1c5b5571af6 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:45.723037 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b28e2c37-1d77-4764-a8f1-d1c5b5571af6 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:45.957839 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b28e2c37-1d77-4764-a8f1-d1c5b5571af6 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:45.966778 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b28e2c37-1d77-4764-a8f1-d1c5b5571af6 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1261 microversion: 2.1 time: 0.276899 Jun 07 13:16:45.967362 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 254/504] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:45 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1261 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:46.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-cf6ecba6-cefe-4f05-8b3f-e4573484c116 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:46.541093 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-cf6ecba6-cefe-4f05-8b3f-e4573484c116 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:46.552568 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cf6ecba6-cefe-4f05-8b3f-e4573484c116 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:46.553646 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cf6ecba6-cefe-4f05-8b3f-e4573484c116 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:46.555378 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cf6ecba6-cefe-4f05-8b3f-e4573484c116 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:46.556417 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cf6ecba6-cefe-4f05-8b3f-e4573484c116 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:46.575089 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:46.710229 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cf6ecba6-cefe-4f05-8b3f-e4573484c116 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:46.718010 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-cf6ecba6-cefe-4f05-8b3f-e4573484c116 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.185410 Jun 07 13:16:46.727164 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 251/505] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:46 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:46.985188 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1777f8de-7203-4882-8d80-8f7833b7904b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:46.985877 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1777f8de-7203-4882-8d80-8f7833b7904b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:47.000054 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1777f8de-7203-4882-8d80-8f7833b7904b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:47.000537 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1777f8de-7203-4882-8d80-8f7833b7904b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:47.001593 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1777f8de-7203-4882-8d80-8f7833b7904b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:47.002193 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1777f8de-7203-4882-8d80-8f7833b7904b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:47.268917 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1777f8de-7203-4882-8d80-8f7833b7904b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:47.276575 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1777f8de-7203-4882-8d80-8f7833b7904b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1261 microversion: 2.1 time: 0.296428 Jun 07 13:16:47.277135 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 255/506] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:46 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1261 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:47.735283 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-39faa171-94ce-4882-baf2-d121aec6ae6a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:47.735915 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-39faa171-94ce-4882-baf2-d121aec6ae6a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:47.742095 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39faa171-94ce-4882-baf2-d121aec6ae6a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:47.742593 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39faa171-94ce-4882-baf2-d121aec6ae6a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:47.743374 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39faa171-94ce-4882-baf2-d121aec6ae6a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:47.744010 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39faa171-94ce-4882-baf2-d121aec6ae6a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:47.920871 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-39faa171-94ce-4882-baf2-d121aec6ae6a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:47.929205 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-39faa171-94ce-4882-baf2-d121aec6ae6a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.197985 Jun 07 13:16:47.930523 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 252/507] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:47 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:48.301284 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-38a30e6b-6d40-426d-bf32-bb2dbc6cb8cb tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:48.303475 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-38a30e6b-6d40-426d-bf32-bb2dbc6cb8cb tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:48.315024 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38a30e6b-6d40-426d-bf32-bb2dbc6cb8cb tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:48.315772 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38a30e6b-6d40-426d-bf32-bb2dbc6cb8cb tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:48.317270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38a30e6b-6d40-426d-bf32-bb2dbc6cb8cb tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:48.317985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38a30e6b-6d40-426d-bf32-bb2dbc6cb8cb tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:48.570168 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-38a30e6b-6d40-426d-bf32-bb2dbc6cb8cb tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:48.580482 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-38a30e6b-6d40-426d-bf32-bb2dbc6cb8cb tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1261 microversion: 2.1 time: 0.287168 Jun 07 13:16:48.581521 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 256/508] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:48 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1261 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:48.712492 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-69673cab-5679-4cd4-a3e8-2b82a881ac34 req-2f2cf73f-f55b-4833-aa60-4d237d98cd74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e18880-cb5c-4346-9a43-a861b07f27a8", "name": "network-vif-plugged", "status": "completed", "tag": "d0c830a1-4526-4f25-a02e-0ee9838a85ba"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:48.721170 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-69673cab-5679-4cd4-a3e8-2b82a881ac34 req-2f2cf73f-f55b-4833-aa60-4d237d98cd74 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:48.721609 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-69673cab-5679-4cd4-a3e8-2b82a881ac34 req-2f2cf73f-f55b-4833-aa60-4d237d98cd74 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:48.734313 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-69673cab-5679-4cd4-a3e8-2b82a881ac34 req-2f2cf73f-f55b-4833-aa60-4d237d98cd74 service nova] Creating event network-vif-plugged:d0c830a1-4526-4f25-a02e-0ee9838a85ba for instance 25e18880-cb5c-4346-9a43-a861b07f27a8 on hv-cinder-84496 Jun 07 13:16:48.739377 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-69673cab-5679-4cd4-a3e8-2b82a881ac34 req-2f2cf73f-f55b-4833-aa60-4d237d98cd74 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030489 Jun 07 13:16:48.740604 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 253/509] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:16:48.946810 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1f23649b-aea5-4c37-a855-de6d24af8955 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:48.947450 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1f23649b-aea5-4c37-a855-de6d24af8955 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:48.954475 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f23649b-aea5-4c37-a855-de6d24af8955 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:48.954932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f23649b-aea5-4c37-a855-de6d24af8955 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:48.955728 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f23649b-aea5-4c37-a855-de6d24af8955 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:48.956185 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f23649b-aea5-4c37-a855-de6d24af8955 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:49.245179 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1f23649b-aea5-4c37-a855-de6d24af8955 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:49.256721 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1f23649b-aea5-4c37-a855-de6d24af8955 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.313680 Jun 07 13:16:49.257553 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 257/510] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:48 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:49.599123 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9e26ce17-2ad3-430e-bb7d-5001bdd40819 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:49.600268 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9e26ce17-2ad3-430e-bb7d-5001bdd40819 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:49.608875 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e26ce17-2ad3-430e-bb7d-5001bdd40819 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:49.609704 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e26ce17-2ad3-430e-bb7d-5001bdd40819 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:49.610851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e26ce17-2ad3-430e-bb7d-5001bdd40819 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:49.612036 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e26ce17-2ad3-430e-bb7d-5001bdd40819 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:49.760281 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9e26ce17-2ad3-430e-bb7d-5001bdd40819 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:49.767799 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9e26ce17-2ad3-430e-bb7d-5001bdd40819 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1261 microversion: 2.1 time: 0.173449 Jun 07 13:16:49.768403 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 254/511] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:49 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:50.275137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-520c7e16-a474-49f8-8a20-97587220e233 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:50.275961 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-520c7e16-a474-49f8-8a20-97587220e233 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:50.283629 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-520c7e16-a474-49f8-8a20-97587220e233 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:50.284661 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-520c7e16-a474-49f8-8a20-97587220e233 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:50.285637 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-520c7e16-a474-49f8-8a20-97587220e233 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:50.286131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-520c7e16-a474-49f8-8a20-97587220e233 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:50.469167 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-520c7e16-a474-49f8-8a20-97587220e233 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:50.484122 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-520c7e16-a474-49f8-8a20-97587220e233 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1501 microversion: 2.1 time: 0.212431 Jun 07 13:16:50.485151 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 258/512] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:50 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1501 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:50.501254 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-029e47d1-fd4c-45ec-ad36-013921bef4a4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24e1b521-5a81-42d0-ae92-84fd43471629"}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:50.502351 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-029e47d1-fd4c-45ec-ad36-013921bef4a4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:50.508709 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-029e47d1-fd4c-45ec-ad36-013921bef4a4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:50.509173 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-029e47d1-fd4c-45ec-ad36-013921bef4a4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:50.509953 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-029e47d1-fd4c-45ec-ad36-013921bef4a4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:50.510378 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-029e47d1-fd4c-45ec-ad36-013921bef4a4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:50.535032 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-029e47d1-fd4c-45ec-ad36-013921bef4a4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] HTTP exception thrown: Cannot 'attach_volume' instance 972b9306-4700-4212-ba99-0654d90e4348 while it is in vm_state rescued Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-029e47d1-fd4c-45ec-ad36-013921bef4a4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Request method failure captured: Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: POST /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348/os-volume_attachments HTTP/1.1 Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 74 Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08fnlwGehPX3-H_Kq_5YwJ5FQsJGwz2frHqKqQ67_UYrSxGEscucac9ZoVlVC7gMud81HUQ5J2_ZlZWeMNcFTo0gNE3uarIqwi2j_-TfEMEZhIE4hhTn76I3Uq5ux-8ZGE780Z7Fsn7Rqn9RqSQPPcytf_qpi5fnis_yDH40YQcQuc Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 562a790e14024341b71d99b5b56fdbfb Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-567307477 Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:16:50.537308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:16:50.538969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_562a790e14024341b71d99b5b56fdbfb", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/562a790e14024341b71d99b5b56fdbfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/562a790e14024341b71d99b5b56fdbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/562a790e14024341b71d99b5b56fdbfb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:16:50.538969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-ServerRescueNegativeTestJSON-567307477 Jun 07 13:16:50.538969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 562a790e14024341b71d99b5b56fdbfb Jun 07 13:16:50.538969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-567307477 Jun 07 13:16:50.538969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-ServerRescueNegativeTestJSON-567307477-project Jun 07 13:16:50.538969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:16:50.538969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:16:50.538969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 3f1820e65ba6475d95f5614a9e035019 Jun 07 13:16:50.538969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-ServerRescueNegativeTestJSON-567307477-project Jun 07 13:16:50.538969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Jun 07 13:16:50.538969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {"volumeAttachment": {"volumeId": "24e1b521-5a81-42d0-ae92-84fd43471629"}} Jun 07 13:16:50.538969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Cannot 'attach_volume' instance 972b9306-4700-4212-ba99-0654d90e4348 while it is in vm_state rescued Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'server_id': '972b9306-4700-4212-ba99-0654d90e4348', 'body': {'volumeAttachment': {'volumeId': '24e1b521-5a81-42d0-ae92-84fd43471629'}}} Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 972b9306-4700-4212-ba99-0654d90e4348 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:16:50.539947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 972b9306-4700-4212-ba99-0654d90e4348 while it is in vm_state rescued Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:16:50.541379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:16:50.542727 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:16:50.542727 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:16:50.542727 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 972b9306-4700-4212-ba99-0654d90e4348 while it is in vm_state rescued Jun 07 13:16:50.542727 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:16:50.543646 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-029e47d1-fd4c-45ec-ad36-013921bef4a4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Returning 409 to user: Cannot 'attach_volume' instance 972b9306-4700-4212-ba99-0654d90e4348 while it is in vm_state rescued {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:16:50.544508 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-029e47d1-fd4c-45ec-ad36-013921bef4a4 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "POST /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047943 Jun 07 13:16:50.545038 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 255/513] 10.222.0.58 () {60 vars in 1322 bytes} [Tue Jun 7 13:16:50 2022] POST /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 07 13:16:50.555215 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a04d0988-40b4-416d-81ec-8e3c217fdfdf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:50.555814 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a04d0988-40b4-416d-81ec-8e3c217fdfdf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:50.563120 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a04d0988-40b4-416d-81ec-8e3c217fdfdf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:50.563830 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a04d0988-40b4-416d-81ec-8e3c217fdfdf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:50.564929 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a04d0988-40b4-416d-81ec-8e3c217fdfdf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:50.565595 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a04d0988-40b4-416d-81ec-8e3c217fdfdf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:50.587638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:50.642572 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a04d0988-40b4-416d-81ec-8e3c217fdfdf tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "POST /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348/action" status: 202 len: 0 microversion: 2.1 time: 0.092309 Jun 07 13:16:50.647041 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 259/514] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jun 7 13:16:50 2022] POST /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:16:50.658577 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b06333bf-e58a-4982-b79f-c93c31167277 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:50.662021 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b06333bf-e58a-4982-b79f-c93c31167277 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:50.677661 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b06333bf-e58a-4982-b79f-c93c31167277 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:50.678380 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b06333bf-e58a-4982-b79f-c93c31167277 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:50.679499 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b06333bf-e58a-4982-b79f-c93c31167277 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:50.680160 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b06333bf-e58a-4982-b79f-c93c31167277 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:50.787358 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-eaf0d12e-f880-4ee5-8f03-94efac918713 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:50.788764 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-eaf0d12e-f880-4ee5-8f03-94efac918713 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:50.797952 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eaf0d12e-f880-4ee5-8f03-94efac918713 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:50.798403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eaf0d12e-f880-4ee5-8f03-94efac918713 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:50.799417 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eaf0d12e-f880-4ee5-8f03-94efac918713 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:50.799850 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eaf0d12e-f880-4ee5-8f03-94efac918713 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:50.822287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b06333bf-e58a-4982-b79f-c93c31167277 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:50.837021 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b06333bf-e58a-4982-b79f-c93c31167277 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1509 microversion: 2.1 time: 0.188493 Jun 07 13:16:50.840846 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 256/515] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:50 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:50.997170 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-eaf0d12e-f880-4ee5-8f03-94efac918713 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:51.006663 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-eaf0d12e-f880-4ee5-8f03-94efac918713 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1261 microversion: 2.1 time: 0.225083 Jun 07 13:16:51.007464 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 260/516] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:50 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1261 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:51.860774 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5de8d143-4b7d-43e1-abe5-60a88a4b3b8e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:51.861375 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5de8d143-4b7d-43e1-abe5-60a88a4b3b8e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:51.867440 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5de8d143-4b7d-43e1-abe5-60a88a4b3b8e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:51.867883 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5de8d143-4b7d-43e1-abe5-60a88a4b3b8e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:51.868630 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5de8d143-4b7d-43e1-abe5-60a88a4b3b8e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:51.869056 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5de8d143-4b7d-43e1-abe5-60a88a4b3b8e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:52.023420 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2b7cf054-6870-4af2-b4a5-1c027ae12345 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:52.024614 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2b7cf054-6870-4af2-b4a5-1c027ae12345 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:52.032768 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2b7cf054-6870-4af2-b4a5-1c027ae12345 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:52.033510 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2b7cf054-6870-4af2-b4a5-1c027ae12345 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:52.034711 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2b7cf054-6870-4af2-b4a5-1c027ae12345 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:52.035950 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2b7cf054-6870-4af2-b4a5-1c027ae12345 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:52.038899 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5de8d143-4b7d-43e1-abe5-60a88a4b3b8e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:52.050539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5de8d143-4b7d-43e1-abe5-60a88a4b3b8e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1509 microversion: 2.1 time: 0.193417 Jun 07 13:16:52.060992 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 257/517] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:51 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:52.212957 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2b7cf054-6870-4af2-b4a5-1c027ae12345 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:52.224494 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2b7cf054-6870-4af2-b4a5-1c027ae12345 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1261 microversion: 2.1 time: 0.205028 Jun 07 13:16:52.225055 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 261/518] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:52 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1261 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:53.088247 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-352a6a7f-884c-4853-a94e-262f99eb8261 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:53.096859 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-352a6a7f-884c-4853-a94e-262f99eb8261 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:53.102127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:53.103764 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-352a6a7f-884c-4853-a94e-262f99eb8261 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:53.104507 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-352a6a7f-884c-4853-a94e-262f99eb8261 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:53.105308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-352a6a7f-884c-4853-a94e-262f99eb8261 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:53.105717 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-352a6a7f-884c-4853-a94e-262f99eb8261 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:53.242896 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7ba9997c-8edc-4846-bac4-ef6e3f5a1d06 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:53.243439 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7ba9997c-8edc-4846-bac4-ef6e3f5a1d06 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:53.255058 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-352a6a7f-884c-4853-a94e-262f99eb8261 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:53.255328 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7ba9997c-8edc-4846-bac4-ef6e3f5a1d06 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:53.255753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7ba9997c-8edc-4846-bac4-ef6e3f5a1d06 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:53.257642 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7ba9997c-8edc-4846-bac4-ef6e3f5a1d06 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:53.258332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7ba9997c-8edc-4846-bac4-ef6e3f5a1d06 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:53.266111 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-352a6a7f-884c-4853-a94e-262f99eb8261 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1509 microversion: 2.1 time: 0.190226 Jun 07 13:16:53.267788 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 258/519] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:53 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:53.453890 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7ba9997c-8edc-4846-bac4-ef6e3f5a1d06 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:53.465930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7ba9997c-8edc-4846-bac4-ef6e3f5a1d06 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1444 microversion: 2.1 time: 0.228507 Jun 07 13:16:53.467443 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 262/520] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:53 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1444 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:16:53.484046 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-61149ae4-b988-43cf-ae4e-dcecd6e1b37f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:53.484686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-61149ae4-b988-43cf-ae4e-dcecd6e1b37f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:53.491645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-61149ae4-b988-43cf-ae4e-dcecd6e1b37f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:53.492120 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-61149ae4-b988-43cf-ae4e-dcecd6e1b37f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:53.492986 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-61149ae4-b988-43cf-ae4e-dcecd6e1b37f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:53.493385 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-61149ae4-b988-43cf-ae4e-dcecd6e1b37f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:53.652139 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-61149ae4-b988-43cf-ae4e-dcecd6e1b37f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:53.661265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-61149ae4-b988-43cf-ae4e-dcecd6e1b37f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1444 microversion: 2.1 time: 0.181066 Jun 07 13:16:53.661861 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 259/521] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:53 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1444 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:54.285949 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7595632f-0cd7-4051-b8aa-dbaaedbe37d7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:54.287218 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7595632f-0cd7-4051-b8aa-dbaaedbe37d7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:54.297060 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7595632f-0cd7-4051-b8aa-dbaaedbe37d7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:54.297523 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7595632f-0cd7-4051-b8aa-dbaaedbe37d7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:54.298473 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7595632f-0cd7-4051-b8aa-dbaaedbe37d7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:54.299063 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7595632f-0cd7-4051-b8aa-dbaaedbe37d7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:54.615234 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7595632f-0cd7-4051-b8aa-dbaaedbe37d7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:54.623399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7595632f-0cd7-4051-b8aa-dbaaedbe37d7 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1509 microversion: 2.1 time: 0.343067 Jun 07 13:16:54.627400 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 263/522] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:54 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1509 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:55.645170 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1b26789f-8014-43ca-867e-ad01450c83aa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:55.645786 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1b26789f-8014-43ca-867e-ad01450c83aa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:55.653043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1b26789f-8014-43ca-867e-ad01450c83aa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:55.653486 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1b26789f-8014-43ca-867e-ad01450c83aa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:55.654251 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1b26789f-8014-43ca-867e-ad01450c83aa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:55.654724 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1b26789f-8014-43ca-867e-ad01450c83aa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:55.791854 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1b26789f-8014-43ca-867e-ad01450c83aa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:55.802128 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1b26789f-8014-43ca-867e-ad01450c83aa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1509 microversion: 2.1 time: 0.160828 Jun 07 13:16:55.803067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 260/523] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:55 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:16:55.960003 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-41ea3c78-4f3f-4083-a0aa-9354f898dd72 req-91e7529b-c41d-49d8-ac87-c2fa9a1d7273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25e18880-cb5c-4346-9a43-a861b07f27a8", "tag": "d0c830a1-4526-4f25-a02e-0ee9838a85ba"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:55.970486 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-41ea3c78-4f3f-4083-a0aa-9354f898dd72 req-91e7529b-c41d-49d8-ac87-c2fa9a1d7273 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:55.971384 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-41ea3c78-4f3f-4083-a0aa-9354f898dd72 req-91e7529b-c41d-49d8-ac87-c2fa9a1d7273 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:55.983977 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-41ea3c78-4f3f-4083-a0aa-9354f898dd72 req-91e7529b-c41d-49d8-ac87-c2fa9a1d7273 service nova] Creating event network-changed:d0c830a1-4526-4f25-a02e-0ee9838a85ba for instance 25e18880-cb5c-4346-9a43-a861b07f27a8 on hv-cinder-84496 Jun 07 13:16:55.989372 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-41ea3c78-4f3f-4083-a0aa-9354f898dd72 req-91e7529b-c41d-49d8-ac87-c2fa9a1d7273 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033620 Jun 07 13:16:55.990074 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 264/524] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:16:56.819940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-dac316a2-b0fe-4761-8785-d6f5140adcd6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:56.820631 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-dac316a2-b0fe-4761-8785-d6f5140adcd6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:56.827594 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dac316a2-b0fe-4761-8785-d6f5140adcd6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:56.828138 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dac316a2-b0fe-4761-8785-d6f5140adcd6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:56.828984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dac316a2-b0fe-4761-8785-d6f5140adcd6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:56.829488 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dac316a2-b0fe-4761-8785-d6f5140adcd6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:57.204447 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-dac316a2-b0fe-4761-8785-d6f5140adcd6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:57.211967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-dac316a2-b0fe-4761-8785-d6f5140adcd6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1515 microversion: 2.1 time: 0.396063 Jun 07 13:16:57.212534 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 261/525] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:56 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1515 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:58.539133 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-639d4eec-f16b-402d-9ef5-666f13c9fbd3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Action: 'create', calling method: .version_select at 0x7fb8e77a9310>, body: {"keypair": {"name": "tempest-keypair-1291931883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMwLHZdfs236c3rVR6ttL7Ri88w8fie1hT17vtT5suJ6zUbU5LNEVd8mKoaJNCT6A32FqxjJxNRtgpMhtHl8D9dqYGY4KzGXsqdaVlyB0SzSPKDUIHCUXnK0g6NBwSi7w=="}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:58.543766 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=62 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:58.555075 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-639d4eec-f16b-402d-9ef5-666f13c9fbd3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Getting quotas for project 562a790e14024341b71d99b5b56fdbfb. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:16:58.558988 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-639d4eec-f16b-402d-9ef5-666f13c9fbd3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Getting quotas for user 3f1820e65ba6475d95f5614a9e035019 and project 562a790e14024341b71d99b5b56fdbfb. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:16:58.583549 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-639d4eec-f16b-402d-9ef5-666f13c9fbd3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049349 Jun 07 13:16:58.584147 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 265/526] 10.222.0.58 () {60 vars in 1158 bytes} [Tue Jun 7 13:16:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:16:59.957590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-2f8f01dc-a1ee-4520-8364-f0a53cb30b1d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1448524421", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa538802-df75-4c2f-ac7b-58fa0b9db040"}], "security_groups": [{"name": "tempest-securitygroup--1402924809"}], "key_name": "tempest-keypair-1291931883", "user_data": "}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:00.063427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.network.neutron [None req-2f8f01dc-a1ee-4520-8364-f0a53cb30b1d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] validate_networks() for [('fa538802-df75-4c2f-ac7b-58fa0b9db040', None, None, None, None, None)] {{(pid=117797) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:17:00.421453 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-2f8f01dc-a1ee-4520-8364-f0a53cb30b1d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Flavor limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:17:00.421878 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-2f8f01dc-a1ee-4520-8364-f0a53cb30b1d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Image limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:17:00.422375 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-2f8f01dc-a1ee-4520-8364-f0a53cb30b1d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Flavor pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:17:00.422895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-2f8f01dc-a1ee-4520-8364-f0a53cb30b1d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Image pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:17:00.423309 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-2f8f01dc-a1ee-4520-8364-f0a53cb30b1d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:17:00.432090 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2f8f01dc-a1ee-4520-8364-f0a53cb30b1d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:00.432533 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2f8f01dc-a1ee-4520-8364-f0a53cb30b1d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:00.433322 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2f8f01dc-a1ee-4520-8364-f0a53cb30b1d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:00.433758 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2f8f01dc-a1ee-4520-8364-f0a53cb30b1d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:00.451592 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-2f8f01dc-a1ee-4520-8364-f0a53cb30b1d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Getting quotas for project 562a790e14024341b71d99b5b56fdbfb. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:17:00.456733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-2f8f01dc-a1ee-4520-8364-f0a53cb30b1d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Getting quotas for user 3f1820e65ba6475d95f5614a9e035019 and project 562a790e14024341b71d99b5b56fdbfb. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:17:00.468602 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-2f8f01dc-a1ee-4520-8364-f0a53cb30b1d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Going to run 1 instances... {{(pid=117797) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:17:00.470951 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-2f8f01dc-a1ee-4520-8364-f0a53cb30b1d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:17:00.516555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-2f8f01dc-a1ee-4520-8364-f0a53cb30b1d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.563429 Jun 07 13:17:00.517252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 262/527] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:16:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:17:00.526995 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d2951c36-5b05-4edc-bc0e-8199b0ed6b8a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:00.527729 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d2951c36-5b05-4edc-bc0e-8199b0ed6b8a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:00.581429 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d2951c36-5b05-4edc-bc0e-8199b0ed6b8a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:00.587947 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d2951c36-5b05-4edc-bc0e-8199b0ed6b8a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1246 microversion: 2.1 time: 0.064883 Jun 07 13:17:00.588534 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 266/528] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:00 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1246 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:01.604053 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7372901f-c854-4689-a561-da1aa2963770 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:01.604662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7372901f-c854-4689-a561-da1aa2963770 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:01.611045 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7372901f-c854-4689-a561-da1aa2963770 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:01.611495 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7372901f-c854-4689-a561-da1aa2963770 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:01.612571 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7372901f-c854-4689-a561-da1aa2963770 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:01.613013 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7372901f-c854-4689-a561-da1aa2963770 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:01.672865 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-7372901f-c854-4689-a561-da1aa2963770 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:01.680158 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-7372901f-c854-4689-a561-da1aa2963770 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1298 microversion: 2.1 time: 0.079959 Jun 07 13:17:01.680719 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 263/529] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:01 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1298 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:02.697458 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1a081b02-941e-47c7-aea0-cefc1003c8b5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:02.698073 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1a081b02-941e-47c7-aea0-cefc1003c8b5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:02.705802 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1a081b02-941e-47c7-aea0-cefc1003c8b5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:02.706251 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1a081b02-941e-47c7-aea0-cefc1003c8b5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:02.707053 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1a081b02-941e-47c7-aea0-cefc1003c8b5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:02.707493 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1a081b02-941e-47c7-aea0-cefc1003c8b5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:02.869256 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1a081b02-941e-47c7-aea0-cefc1003c8b5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:02.876758 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1a081b02-941e-47c7-aea0-cefc1003c8b5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1372 microversion: 2.1 time: 0.183100 Jun 07 13:17:02.877281 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 267/530] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:02 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:03.465187 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-7b10fa78-cd10-4d2d-b787-9591faa9f8d3 req-77a9e4bb-db95-46b7-b91a-59094576604a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc2b109-2c98-4fdc-b735-5df0ced46167", "tag": "3566a568-9f54-445c-8198-4bb46048ae8a"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:03.474649 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-7b10fa78-cd10-4d2d-b787-9591faa9f8d3 req-77a9e4bb-db95-46b7-b91a-59094576604a service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:03.475096 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-7b10fa78-cd10-4d2d-b787-9591faa9f8d3 req-77a9e4bb-db95-46b7-b91a-59094576604a service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:03.493083 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-7b10fa78-cd10-4d2d-b787-9591faa9f8d3 req-77a9e4bb-db95-46b7-b91a-59094576604a service nova] Creating event network-changed:3566a568-9f54-445c-8198-4bb46048ae8a for instance bfc2b109-2c98-4fdc-b735-5df0ced46167 on hv-cinder-84496 Jun 07 13:17:03.499471 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-7b10fa78-cd10-4d2d-b787-9591faa9f8d3 req-77a9e4bb-db95-46b7-b91a-59094576604a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037298 Jun 07 13:17:03.500084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 264/531] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:03.892845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f10f2361-e18e-46a4-bad7-28d2dd34d5fe tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:03.893453 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f10f2361-e18e-46a4-bad7-28d2dd34d5fe tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:03.899881 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f10f2361-e18e-46a4-bad7-28d2dd34d5fe tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:03.900330 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f10f2361-e18e-46a4-bad7-28d2dd34d5fe tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:03.901086 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f10f2361-e18e-46a4-bad7-28d2dd34d5fe tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:03.901565 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f10f2361-e18e-46a4-bad7-28d2dd34d5fe tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:04.033058 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f10f2361-e18e-46a4-bad7-28d2dd34d5fe tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:04.040711 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f10f2361-e18e-46a4-bad7-28d2dd34d5fe tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1372 microversion: 2.1 time: 0.151686 Jun 07 13:17:04.041275 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 268/532] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:03 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:05.057804 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d09ec5ba-3762-4397-917f-ab2c1f6727d1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:05.058467 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d09ec5ba-3762-4397-917f-ab2c1f6727d1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:05.065276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d09ec5ba-3762-4397-917f-ab2c1f6727d1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:05.065725 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d09ec5ba-3762-4397-917f-ab2c1f6727d1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:05.066514 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d09ec5ba-3762-4397-917f-ab2c1f6727d1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:05.066957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d09ec5ba-3762-4397-917f-ab2c1f6727d1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:05.192222 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d09ec5ba-3762-4397-917f-ab2c1f6727d1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:05.199563 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d09ec5ba-3762-4397-917f-ab2c1f6727d1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1372 microversion: 2.1 time: 0.146158 Jun 07 13:17:05.200133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 265/533] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:05 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:17:06.216088 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-056b3e0e-32e6-413a-8906-5565388f8a3d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:06.216643 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-056b3e0e-32e6-413a-8906-5565388f8a3d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:06.223095 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-056b3e0e-32e6-413a-8906-5565388f8a3d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:06.223539 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-056b3e0e-32e6-413a-8906-5565388f8a3d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:06.224288 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-056b3e0e-32e6-413a-8906-5565388f8a3d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:06.224718 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-056b3e0e-32e6-413a-8906-5565388f8a3d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:06.348194 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-056b3e0e-32e6-413a-8906-5565388f8a3d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:06.355618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-056b3e0e-32e6-413a-8906-5565388f8a3d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1372 microversion: 2.1 time: 0.143472 Jun 07 13:17:06.356214 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 269/534] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:06 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1372 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:07.372207 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1994792b-a0fc-4ac9-8910-cc8b6accc980 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:07.372812 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1994792b-a0fc-4ac9-8910-cc8b6accc980 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:07.379076 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1994792b-a0fc-4ac9-8910-cc8b6accc980 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:07.379514 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1994792b-a0fc-4ac9-8910-cc8b6accc980 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:07.380422 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1994792b-a0fc-4ac9-8910-cc8b6accc980 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:07.381048 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1994792b-a0fc-4ac9-8910-cc8b6accc980 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:07.518875 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1994792b-a0fc-4ac9-8910-cc8b6accc980 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:07.526341 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1994792b-a0fc-4ac9-8910-cc8b6accc980 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1372 microversion: 2.1 time: 0.157979 Jun 07 13:17:07.526945 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 266/535] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:07 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:08.543740 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f2fb9f19-0cbd-40e3-b977-35eadbd2235c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:08.544354 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f2fb9f19-0cbd-40e3-b977-35eadbd2235c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:08.550814 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f2fb9f19-0cbd-40e3-b977-35eadbd2235c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:08.551293 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f2fb9f19-0cbd-40e3-b977-35eadbd2235c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:08.552049 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f2fb9f19-0cbd-40e3-b977-35eadbd2235c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:08.552486 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f2fb9f19-0cbd-40e3-b977-35eadbd2235c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:08.680879 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f2fb9f19-0cbd-40e3-b977-35eadbd2235c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:08.688983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f2fb9f19-0cbd-40e3-b977-35eadbd2235c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1372 microversion: 2.1 time: 0.149017 Jun 07 13:17:08.689554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 270/536] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:08 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:09.705481 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-88226833-4992-413a-a2b9-18a27c449996 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:09.706007 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-88226833-4992-413a-a2b9-18a27c449996 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:09.711900 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-88226833-4992-413a-a2b9-18a27c449996 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:09.712340 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-88226833-4992-413a-a2b9-18a27c449996 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:09.713084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-88226833-4992-413a-a2b9-18a27c449996 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:09.713507 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-88226833-4992-413a-a2b9-18a27c449996 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:09.838900 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-88226833-4992-413a-a2b9-18a27c449996 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:09.846249 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-88226833-4992-413a-a2b9-18a27c449996 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1372 microversion: 2.1 time: 0.145154 Jun 07 13:17:09.846840 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 267/537] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:09 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1372 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:10.863287 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9cd2a3d0-2332-4b74-a363-e8b55d80e072 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:10.864024 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9cd2a3d0-2332-4b74-a363-e8b55d80e072 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:10.866749 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:10.872713 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9cd2a3d0-2332-4b74-a363-e8b55d80e072 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:10.873166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9cd2a3d0-2332-4b74-a363-e8b55d80e072 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:10.873938 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9cd2a3d0-2332-4b74-a363-e8b55d80e072 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:10.874376 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9cd2a3d0-2332-4b74-a363-e8b55d80e072 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:11.000843 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9cd2a3d0-2332-4b74-a363-e8b55d80e072 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:11.008214 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9cd2a3d0-2332-4b74-a363-e8b55d80e072 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1372 microversion: 2.1 time: 0.149673 Jun 07 13:17:11.008781 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 271/538] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:10 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:17:11.222185 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-9a1f53fe-7c33-4fb1-af10-dec3181f0eac req-97045393-f7dc-4578-a8f2-f06d58199341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc2b109-2c98-4fdc-b735-5df0ced46167", "name": "network-vif-plugged", "status": "completed", "tag": "3566a568-9f54-445c-8198-4bb46048ae8a"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:11.225744 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=2 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:11.226416 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=6 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:11.232219 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-9a1f53fe-7c33-4fb1-af10-dec3181f0eac req-97045393-f7dc-4578-a8f2-f06d58199341 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:11.232663 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-9a1f53fe-7c33-4fb1-af10-dec3181f0eac req-97045393-f7dc-4578-a8f2-f06d58199341 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:11.244284 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-9a1f53fe-7c33-4fb1-af10-dec3181f0eac req-97045393-f7dc-4578-a8f2-f06d58199341 service nova] Creating event network-vif-plugged:3566a568-9f54-445c-8198-4bb46048ae8a for instance bfc2b109-2c98-4fdc-b735-5df0ced46167 on hv-cinder-84496 Jun 07 13:17:11.249149 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-9a1f53fe-7c33-4fb1-af10-dec3181f0eac req-97045393-f7dc-4578-a8f2-f06d58199341 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031414 Jun 07 13:17:11.249962 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 268/539] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:12.025445 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a80ebdd1-a9cb-45cc-94de-e55ddb79f895 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:12.026052 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a80ebdd1-a9cb-45cc-94de-e55ddb79f895 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:12.032463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a80ebdd1-a9cb-45cc-94de-e55ddb79f895 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:12.032902 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a80ebdd1-a9cb-45cc-94de-e55ddb79f895 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:12.033915 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a80ebdd1-a9cb-45cc-94de-e55ddb79f895 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:12.034346 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a80ebdd1-a9cb-45cc-94de-e55ddb79f895 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:12.086606 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d92d59b4-8c2e-4f0d-a839-608c90c54d1b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:12.087104 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d92d59b4-8c2e-4f0d-a839-608c90c54d1b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:12.093305 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d92d59b4-8c2e-4f0d-a839-608c90c54d1b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:12.094252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d92d59b4-8c2e-4f0d-a839-608c90c54d1b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:12.095043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d92d59b4-8c2e-4f0d-a839-608c90c54d1b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:12.095476 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d92d59b4-8c2e-4f0d-a839-608c90c54d1b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:12.121085 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d92d59b4-8c2e-4f0d-a839-608c90c54d1b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0/ips" status: 200 len: 149 microversion: 2.1 time: 0.038779 Jun 07 13:17:12.121665 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 269/540] 10.222.0.58 () {58 vars in 1247 bytes} [Tue Jun 7 13:17:12 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:17:12.164366 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a80ebdd1-a9cb-45cc-94de-e55ddb79f895 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:12.172474 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a80ebdd1-a9cb-45cc-94de-e55ddb79f895 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1372 microversion: 2.1 time: 0.150304 Jun 07 13:17:12.173033 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 272/541] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:12 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:17:13.189536 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1e77c88d-51ad-4583-9849-5392c9a51447 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:13.190142 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1e77c88d-51ad-4583-9849-5392c9a51447 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:13.196164 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1e77c88d-51ad-4583-9849-5392c9a51447 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:13.196611 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1e77c88d-51ad-4583-9849-5392c9a51447 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:13.197358 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1e77c88d-51ad-4583-9849-5392c9a51447 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:13.197787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1e77c88d-51ad-4583-9849-5392c9a51447 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:13.323916 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1e77c88d-51ad-4583-9849-5392c9a51447 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:13.331646 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1e77c88d-51ad-4583-9849-5392c9a51447 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1372 microversion: 2.1 time: 0.146503 Jun 07 13:17:13.332194 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 270/542] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:13 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:14.348162 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-16ce6c64-656c-4b67-a931-8b0731086764 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:14.348840 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-16ce6c64-656c-4b67-a931-8b0731086764 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:14.355272 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-16ce6c64-656c-4b67-a931-8b0731086764 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:14.355722 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-16ce6c64-656c-4b67-a931-8b0731086764 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:14.356488 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-16ce6c64-656c-4b67-a931-8b0731086764 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:14.356922 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-16ce6c64-656c-4b67-a931-8b0731086764 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:14.484666 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-16ce6c64-656c-4b67-a931-8b0731086764 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:14.492056 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-16ce6c64-656c-4b67-a931-8b0731086764 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1565 microversion: 2.1 time: 0.147803 Jun 07 13:17:14.492619 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 273/543] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:14 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:14.509798 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3a9d3a0d-5e7b-4187-8a0c-493ca7ef380f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:14.510425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3a9d3a0d-5e7b-4187-8a0c-493ca7ef380f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:14.516974 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3a9d3a0d-5e7b-4187-8a0c-493ca7ef380f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:14.517415 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3a9d3a0d-5e7b-4187-8a0c-493ca7ef380f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:14.518166 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3a9d3a0d-5e7b-4187-8a0c-493ca7ef380f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:14.518627 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3a9d3a0d-5e7b-4187-8a0c-493ca7ef380f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:14.527803 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-35045bb4-89c5-45b1-8477-089705995e46 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "464914cf-2981-4b30-9de2-05ac3d8fe8c9"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:14.528920 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-35045bb4-89c5-45b1-8477-089705995e46 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:14.532162 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:14.535354 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-35045bb4-89c5-45b1-8477-089705995e46 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:14.536008 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-35045bb4-89c5-45b1-8477-089705995e46 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:14.536774 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-35045bb4-89c5-45b1-8477-089705995e46 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:14.537210 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-35045bb4-89c5-45b1-8477-089705995e46 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:14.597612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3a9d3a0d-5e7b-4187-8a0c-493ca7ef380f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091603 Jun 07 13:17:14.598261 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 271/544] 10.222.0.58 () {58 vars in 1274 bytes} [Tue Jun 7 13:17:14 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:15.679251 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-1ef8ce0b-05ac-464a-9992-77e1c1ca8263 req-e70cef62-7ac7-4711-ad51-0e23fbd4a1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc2b109-2c98-4fdc-b735-5df0ced46167", "tag": "3566a568-9f54-445c-8198-4bb46048ae8a"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:15.688064 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-1ef8ce0b-05ac-464a-9992-77e1c1ca8263 req-e70cef62-7ac7-4711-ad51-0e23fbd4a1f8 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:15.688607 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-1ef8ce0b-05ac-464a-9992-77e1c1ca8263 req-e70cef62-7ac7-4711-ad51-0e23fbd4a1f8 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:15.700188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-1ef8ce0b-05ac-464a-9992-77e1c1ca8263 req-e70cef62-7ac7-4711-ad51-0e23fbd4a1f8 service nova] Creating event network-changed:3566a568-9f54-445c-8198-4bb46048ae8a for instance bfc2b109-2c98-4fdc-b735-5df0ced46167 on hv-cinder-84496 Jun 07 13:17:15.705294 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-1ef8ce0b-05ac-464a-9992-77e1c1ca8263 req-e70cef62-7ac7-4711-ad51-0e23fbd4a1f8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029819 Jun 07 13:17:15.705909 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 272/545] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:18.299011 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-35045bb4-89c5-45b1-8477-089705995e46 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "POST /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.774799 Jun 07 13:17:18.300165 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 274/546] 10.222.0.58 () {60 vars in 1322 bytes} [Tue Jun 7 13:17:14 2022] POST /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0/os-volume_attachments => generated 194 bytes in 3777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:17:22.810779 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-24801fbc-a05e-4be4-8198-7a1df84cd552 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:22.811319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-24801fbc-a05e-4be4-8198-7a1df84cd552 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:22.817882 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-24801fbc-a05e-4be4-8198-7a1df84cd552 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:22.818319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-24801fbc-a05e-4be4-8198-7a1df84cd552 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:22.819093 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-24801fbc-a05e-4be4-8198-7a1df84cd552 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:22.819529 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-24801fbc-a05e-4be4-8198-7a1df84cd552 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:22.842793 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-24801fbc-a05e-4be4-8198-7a1df84cd552 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/ips" status: 200 len: 146 microversion: 2.1 time: 0.036216 Jun 07 13:17:22.843406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 273/547] 10.222.0.58 () {58 vars in 1247 bytes} [Tue Jun 7 13:17:22 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:26.995142 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:27.000660 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bc3c338b-6cf8-454c-8d65-2e5225179a94 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc3dba68-3142-4cb2-8d65-7d66f8e67d5a"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:27.001846 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bc3c338b-6cf8-454c-8d65-2e5225179a94 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:27.008767 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc3c338b-6cf8-454c-8d65-2e5225179a94 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:27.009218 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc3c338b-6cf8-454c-8d65-2e5225179a94 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:27.009984 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc3c338b-6cf8-454c-8d65-2e5225179a94 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:27.010423 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc3c338b-6cf8-454c-8d65-2e5225179a94 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:27.014528 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:31.019805 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bc3c338b-6cf8-454c-8d65-2e5225179a94 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "POST /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.025927 Jun 07 13:17:31.020459 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 275/548] 10.222.0.58 () {60 vars in 1322 bytes} [Tue Jun 7 13:17:26 2022] POST /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/os-volume_attachments => generated 194 bytes in 4028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:33.158412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a805b4ce-86a8-45e0-875f-9ef354fd8377 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Action: 'create', calling method: .version_select at 0x7fb8f406f820>, body: {"keypair": {"name": "tempest-keypair-429549322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6ocGlPqu6A0QAy1XvGIz0Olcaq8tqCTf6v7k1vhQxqprQmZFUYJo3nGI0sZSyUFZ4I732NECVRCRKbjdt02xL3eVURXITisqI4eslH6MOimDWYfMfAY4tJZkTC6oZr0w=="}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:33.162741 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:33.163404 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=7 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:33.177848 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-a805b4ce-86a8-45e0-875f-9ef354fd8377 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Getting quotas for project 3fd6f908209c418490bccdbdef7691a5. Resources: {'key_pairs'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:17:33.185309 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-a805b4ce-86a8-45e0-875f-9ef354fd8377 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Getting quotas for user 3f1a9bfb57f64b85b635c29090aa498c and project 3fd6f908209c418490bccdbdef7691a5. Resources: {'key_pairs'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:17:33.196842 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a805b4ce-86a8-45e0-875f-9ef354fd8377 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [cf0b2c5a-51e5-4b4c-abc3-3787265fec96] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 13:17:34.204301 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO oslo.messaging._drivers.impl_rabbit [None req-a805b4ce-86a8-45e0-875f-9ef354fd8377 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [cf0b2c5a-51e5-4b4c-abc3-3787265fec96] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 54008. Jun 07 13:17:34.219115 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a805b4ce-86a8-45e0-875f-9ef354fd8377 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.064845 Jun 07 13:17:34.219752 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 274/549] 10.222.0.58 () {60 vars in 1158 bytes} [Tue Jun 7 13:17:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:35.512298 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f506016b-9872-4703-afc6-e3b7042b0b28 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-794812359", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a83b14f0-daca-457b-9e46-5ac0b9a7ecdf"}], "security_groups": [{"name": "tempest-securitygroup--1197598103"}], "key_name": "tempest-keypair-429549322", "user_data": "}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:35.617858 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-f506016b-9872-4703-afc6-e3b7042b0b28 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] validate_networks() for [('a83b14f0-daca-457b-9e46-5ac0b9a7ecdf', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:17:36.228745 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-f506016b-9872-4703-afc6-e3b7042b0b28 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:17:36.229167 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-f506016b-9872-4703-afc6-e3b7042b0b28 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:17:36.229643 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-f506016b-9872-4703-afc6-e3b7042b0b28 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:17:36.230052 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-f506016b-9872-4703-afc6-e3b7042b0b28 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:17:36.230488 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-f506016b-9872-4703-afc6-e3b7042b0b28 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:17:36.239250 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f506016b-9872-4703-afc6-e3b7042b0b28 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:36.239701 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f506016b-9872-4703-afc6-e3b7042b0b28 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:36.240497 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f506016b-9872-4703-afc6-e3b7042b0b28 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:36.240934 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f506016b-9872-4703-afc6-e3b7042b0b28 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:36.258429 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-f506016b-9872-4703-afc6-e3b7042b0b28 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Getting quotas for project 3fd6f908209c418490bccdbdef7691a5. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:17:36.262366 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-f506016b-9872-4703-afc6-e3b7042b0b28 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Getting quotas for user 3f1a9bfb57f64b85b635c29090aa498c and project 3fd6f908209c418490bccdbdef7691a5. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:17:36.273948 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f506016b-9872-4703-afc6-e3b7042b0b28 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:17:36.276311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f506016b-9872-4703-afc6-e3b7042b0b28 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:17:36.324279 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f506016b-9872-4703-afc6-e3b7042b0b28 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.817643 Jun 07 13:17:36.330323 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 276/550] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:17:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:17:36.335571 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1aeddc1d-d5e6-4c02-afc7-46fb05de6ff2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:36.336781 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1aeddc1d-d5e6-4c02-afc7-46fb05de6ff2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:36.390607 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1aeddc1d-d5e6-4c02-afc7-46fb05de6ff2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:36.398003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1aeddc1d-d5e6-4c02-afc7-46fb05de6ff2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1240 microversion: 2.1 time: 0.066443 Jun 07 13:17:36.398583 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 275/551] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:36 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:37.422214 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5b4ebae8-8fc3-4d9f-9608-618233edb48f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:37.423016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5b4ebae8-8fc3-4d9f-9608-618233edb48f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:37.430310 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5b4ebae8-8fc3-4d9f-9608-618233edb48f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:37.430796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5b4ebae8-8fc3-4d9f-9608-618233edb48f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:37.431558 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5b4ebae8-8fc3-4d9f-9608-618233edb48f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:37.432186 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5b4ebae8-8fc3-4d9f-9608-618233edb48f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:37.505631 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5b4ebae8-8fc3-4d9f-9608-618233edb48f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:37.515939 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5b4ebae8-8fc3-4d9f-9608-618233edb48f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1300 microversion: 2.1 time: 0.101017 Jun 07 13:17:37.517557 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 277/552] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:37 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:38.535896 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b343cea0-6168-492f-98fd-ecd19332ecac tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:38.536637 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b343cea0-6168-492f-98fd-ecd19332ecac tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:38.542650 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b343cea0-6168-492f-98fd-ecd19332ecac tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:38.543210 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b343cea0-6168-492f-98fd-ecd19332ecac tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:38.544030 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b343cea0-6168-492f-98fd-ecd19332ecac tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:38.544533 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b343cea0-6168-492f-98fd-ecd19332ecac tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:38.753113 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b343cea0-6168-492f-98fd-ecd19332ecac tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:38.761043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b343cea0-6168-492f-98fd-ecd19332ecac tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1366 microversion: 2.1 time: 0.230466 Jun 07 13:17:38.761618 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 276/553] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:38 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:39.783577 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a60c2e89-488f-4f66-815a-20ebdda3db70 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:39.784301 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a60c2e89-488f-4f66-815a-20ebdda3db70 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:39.799913 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a60c2e89-488f-4f66-815a-20ebdda3db70 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:39.802669 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a60c2e89-488f-4f66-815a-20ebdda3db70 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:39.803773 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a60c2e89-488f-4f66-815a-20ebdda3db70 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:39.804477 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a60c2e89-488f-4f66-815a-20ebdda3db70 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:39.849848 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-8ae175f5-ea91-443d-bddf-a58becc679f7 req-58cbf674-20b3-4de1-9d11-f193118d7fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5728ed-f056-462a-952e-ce2c4fd06b96", "tag": "03e4ee37-b76d-476a-8b2a-6aca0431452d"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:39.860732 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-8ae175f5-ea91-443d-bddf-a58becc679f7 req-58cbf674-20b3-4de1-9d11-f193118d7fc2 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:39.861430 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-8ae175f5-ea91-443d-bddf-a58becc679f7 req-58cbf674-20b3-4de1-9d11-f193118d7fc2 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:39.879944 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-8ae175f5-ea91-443d-bddf-a58becc679f7 req-58cbf674-20b3-4de1-9d11-f193118d7fc2 service nova] Creating event network-changed:03e4ee37-b76d-476a-8b2a-6aca0431452d for instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 on hv-cinder-84496 Jun 07 13:17:39.886655 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-8ae175f5-ea91-443d-bddf-a58becc679f7 req-58cbf674-20b3-4de1-9d11-f193118d7fc2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069618 Jun 07 13:17:39.887918 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 277/554] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:40.073983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a60c2e89-488f-4f66-815a-20ebdda3db70 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:40.082201 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a60c2e89-488f-4f66-815a-20ebdda3db70 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1366 microversion: 2.1 time: 0.304425 Jun 07 13:17:40.092783 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 278/555] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:39 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:40.714427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3203cad3-d051-4437-bfbd-ba64cf7c6b25 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:40.723825 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3203cad3-d051-4437-bfbd-ba64cf7c6b25 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:40.724457 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3203cad3-d051-4437-bfbd-ba64cf7c6b25 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:40.799370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3203cad3-d051-4437-bfbd-ba64cf7c6b25 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Going to try to stop instance {{(pid=117797) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 13:17:40.860882 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3203cad3-d051-4437-bfbd-ba64cf7c6b25 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "POST /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/action" status: 202 len: 0 microversion: 2.1 time: 0.150072 Jun 07 13:17:40.872272 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1f4e0e1d-c1ad-4b14-a1fd-8b50b7e40b23 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:40.872893 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1f4e0e1d-c1ad-4b14-a1fd-8b50b7e40b23 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:40.878004 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 278/556] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jun 7 13:17:40 2022] POST /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:17:40.883598 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f4e0e1d-c1ad-4b14-a1fd-8b50b7e40b23 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:40.884243 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f4e0e1d-c1ad-4b14-a1fd-8b50b7e40b23 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:40.885380 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f4e0e1d-c1ad-4b14-a1fd-8b50b7e40b23 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:40.886140 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f4e0e1d-c1ad-4b14-a1fd-8b50b7e40b23 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:41.094112 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1f4e0e1d-c1ad-4b14-a1fd-8b50b7e40b23 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:41.100971 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1a37ba59-cb98-448f-813b-fbdf2b74412e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:41.101872 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1a37ba59-cb98-448f-813b-fbdf2b74412e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:41.105030 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1f4e0e1d-c1ad-4b14-a1fd-8b50b7e40b23 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1725 microversion: 2.1 time: 0.238050 Jun 07 13:17:41.106032 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 279/557] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:40 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:41.123122 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1a37ba59-cb98-448f-813b-fbdf2b74412e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:41.124474 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1a37ba59-cb98-448f-813b-fbdf2b74412e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:41.125276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1a37ba59-cb98-448f-813b-fbdf2b74412e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:41.126295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1a37ba59-cb98-448f-813b-fbdf2b74412e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:41.360053 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1a37ba59-cb98-448f-813b-fbdf2b74412e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:41.369662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1a37ba59-cb98-448f-813b-fbdf2b74412e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1366 microversion: 2.1 time: 0.273656 Jun 07 13:17:41.370397 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 279/558] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:41 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:17:42.123071 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4c787c33-8a85-40b2-98ed-237ad911a7d2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:42.124313 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4c787c33-8a85-40b2-98ed-237ad911a7d2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:42.131588 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c787c33-8a85-40b2-98ed-237ad911a7d2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:42.132230 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c787c33-8a85-40b2-98ed-237ad911a7d2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:42.133227 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c787c33-8a85-40b2-98ed-237ad911a7d2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:42.133656 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c787c33-8a85-40b2-98ed-237ad911a7d2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:42.277481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4c787c33-8a85-40b2-98ed-237ad911a7d2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:42.286419 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4c787c33-8a85-40b2-98ed-237ad911a7d2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1725 microversion: 2.1 time: 0.167274 Jun 07 13:17:42.287031 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 280/559] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:42 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:42.386749 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ea3017fe-4fa4-4bd9-97d6-1a626523ab58 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:42.387356 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ea3017fe-4fa4-4bd9-97d6-1a626523ab58 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:42.393994 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ea3017fe-4fa4-4bd9-97d6-1a626523ab58 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:42.394471 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ea3017fe-4fa4-4bd9-97d6-1a626523ab58 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:42.395236 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ea3017fe-4fa4-4bd9-97d6-1a626523ab58 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:42.395662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ea3017fe-4fa4-4bd9-97d6-1a626523ab58 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:42.617370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ea3017fe-4fa4-4bd9-97d6-1a626523ab58 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:42.628750 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ea3017fe-4fa4-4bd9-97d6-1a626523ab58 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1366 microversion: 2.1 time: 0.245793 Jun 07 13:17:42.629497 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 280/560] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:42 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:43.304759 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2850c63d-b7b8-4fd2-a964-74f47db76cc0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:43.305395 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2850c63d-b7b8-4fd2-a964-74f47db76cc0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:43.313785 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2850c63d-b7b8-4fd2-a964-74f47db76cc0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:43.314376 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2850c63d-b7b8-4fd2-a964-74f47db76cc0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:43.315463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2850c63d-b7b8-4fd2-a964-74f47db76cc0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:43.316099 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2850c63d-b7b8-4fd2-a964-74f47db76cc0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:43.463452 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2850c63d-b7b8-4fd2-a964-74f47db76cc0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:43.472722 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2850c63d-b7b8-4fd2-a964-74f47db76cc0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1725 microversion: 2.1 time: 0.172480 Jun 07 13:17:43.473311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 281/561] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:43 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:43.648184 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-72b20ff2-2d7b-4b08-8e88-5bf5ef6c0676 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:43.649504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-72b20ff2-2d7b-4b08-8e88-5bf5ef6c0676 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:43.662360 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-72b20ff2-2d7b-4b08-8e88-5bf5ef6c0676 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:43.664661 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-72b20ff2-2d7b-4b08-8e88-5bf5ef6c0676 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:43.667122 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-72b20ff2-2d7b-4b08-8e88-5bf5ef6c0676 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:43.669208 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-72b20ff2-2d7b-4b08-8e88-5bf5ef6c0676 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:43.867504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-72b20ff2-2d7b-4b08-8e88-5bf5ef6c0676 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:43.877096 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-72b20ff2-2d7b-4b08-8e88-5bf5ef6c0676 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1366 microversion: 2.1 time: 0.235645 Jun 07 13:17:43.878475 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 281/562] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:43 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:44.490237 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-010f9b3d-3966-42a9-8d16-f8340a2e7115 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:44.491062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-010f9b3d-3966-42a9-8d16-f8340a2e7115 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:44.497859 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-010f9b3d-3966-42a9-8d16-f8340a2e7115 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:44.498426 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-010f9b3d-3966-42a9-8d16-f8340a2e7115 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:44.499865 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-010f9b3d-3966-42a9-8d16-f8340a2e7115 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:44.500414 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-010f9b3d-3966-42a9-8d16-f8340a2e7115 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:44.644173 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-010f9b3d-3966-42a9-8d16-f8340a2e7115 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:44.655380 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-010f9b3d-3966-42a9-8d16-f8340a2e7115 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1725 microversion: 2.1 time: 0.168559 Jun 07 13:17:44.656419 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 282/563] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:44 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:44.900680 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7d49ad9e-1423-465f-85a9-ede5225d124a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:44.901278 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7d49ad9e-1423-465f-85a9-ede5225d124a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:44.910720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7d49ad9e-1423-465f-85a9-ede5225d124a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:44.911359 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7d49ad9e-1423-465f-85a9-ede5225d124a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:44.912380 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7d49ad9e-1423-465f-85a9-ede5225d124a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:44.912990 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7d49ad9e-1423-465f-85a9-ede5225d124a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:45.368386 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-7d49ad9e-1423-465f-85a9-ede5225d124a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:45.376653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-7d49ad9e-1423-465f-85a9-ede5225d124a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1366 microversion: 2.1 time: 0.482763 Jun 07 13:17:45.386317 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 282/564] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:44 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1366 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:45.676771 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7f6d1b28-7e10-4872-a33a-12d5dd73cc0b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:45.677931 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7f6d1b28-7e10-4872-a33a-12d5dd73cc0b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:45.697312 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7f6d1b28-7e10-4872-a33a-12d5dd73cc0b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:45.697887 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7f6d1b28-7e10-4872-a33a-12d5dd73cc0b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:45.698918 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7f6d1b28-7e10-4872-a33a-12d5dd73cc0b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:45.699518 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7f6d1b28-7e10-4872-a33a-12d5dd73cc0b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:45.971692 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7f6d1b28-7e10-4872-a33a-12d5dd73cc0b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:45.983428 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7f6d1b28-7e10-4872-a33a-12d5dd73cc0b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1725 microversion: 2.1 time: 0.312954 Jun 07 13:17:45.995794 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 283/565] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:45 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1725 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:46.394791 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-af61343e-b668-4108-aa74-d8b60ddd00fa tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:46.395423 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-af61343e-b668-4108-aa74-d8b60ddd00fa tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:46.397704 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=6 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:46.406243 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-af61343e-b668-4108-aa74-d8b60ddd00fa tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:46.408642 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-af61343e-b668-4108-aa74-d8b60ddd00fa tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:46.410885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-af61343e-b668-4108-aa74-d8b60ddd00fa tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:46.412134 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-af61343e-b668-4108-aa74-d8b60ddd00fa tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:46.741198 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-af61343e-b668-4108-aa74-d8b60ddd00fa tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:46.758520 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-af61343e-b668-4108-aa74-d8b60ddd00fa tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1366 microversion: 2.1 time: 0.369170 Jun 07 13:17:46.759119 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 283/566] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:46 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:47.001117 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f4880c69-282f-4264-87a4-70efd0ff8fbd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:47.002287 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f4880c69-282f-4264-87a4-70efd0ff8fbd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:47.009598 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:47.011415 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:47.022112 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f4880c69-282f-4264-87a4-70efd0ff8fbd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:47.023421 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f4880c69-282f-4264-87a4-70efd0ff8fbd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:47.027799 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f4880c69-282f-4264-87a4-70efd0ff8fbd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:47.028509 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f4880c69-282f-4264-87a4-70efd0ff8fbd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:47.372706 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f4880c69-282f-4264-87a4-70efd0ff8fbd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:47.392969 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f4880c69-282f-4264-87a4-70efd0ff8fbd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1725 microversion: 2.1 time: 0.394334 Jun 07 13:17:47.393771 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 284/567] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:46 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1725 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:47.786880 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-07706f6b-48be-45b5-ace8-ab1bcecbdd88 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:47.787953 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-07706f6b-48be-45b5-ace8-ab1bcecbdd88 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:47.811048 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-07706f6b-48be-45b5-ace8-ab1bcecbdd88 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:47.812518 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-07706f6b-48be-45b5-ace8-ab1bcecbdd88 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:47.813527 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-07706f6b-48be-45b5-ace8-ab1bcecbdd88 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:47.814133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-07706f6b-48be-45b5-ace8-ab1bcecbdd88 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:48.042028 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-07706f6b-48be-45b5-ace8-ab1bcecbdd88 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:48.060194 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-07706f6b-48be-45b5-ace8-ab1bcecbdd88 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1366 microversion: 2.1 time: 0.288257 Jun 07 13:17:48.060784 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 284/568] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:47 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:48.411683 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ca7ec9c5-1f9c-4106-9ce0-6973274e3b16 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:48.412306 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ca7ec9c5-1f9c-4106-9ce0-6973274e3b16 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:48.419704 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ca7ec9c5-1f9c-4106-9ce0-6973274e3b16 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:48.420168 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ca7ec9c5-1f9c-4106-9ce0-6973274e3b16 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:48.421238 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ca7ec9c5-1f9c-4106-9ce0-6973274e3b16 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:48.421620 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ca7ec9c5-1f9c-4106-9ce0-6973274e3b16 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:48.578222 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ca7ec9c5-1f9c-4106-9ce0-6973274e3b16 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:48.601110 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ca7ec9c5-1f9c-4106-9ce0-6973274e3b16 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1725 microversion: 2.1 time: 0.194543 Jun 07 13:17:48.602009 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 285/569] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:48 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:49.078718 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a1c2599f-a1ba-41f9-8d1c-0f4b87553461 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:49.080157 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a1c2599f-a1ba-41f9-8d1c-0f4b87553461 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:49.088384 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a1c2599f-a1ba-41f9-8d1c-0f4b87553461 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:49.089728 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a1c2599f-a1ba-41f9-8d1c-0f4b87553461 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:49.090826 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a1c2599f-a1ba-41f9-8d1c-0f4b87553461 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:49.091630 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a1c2599f-a1ba-41f9-8d1c-0f4b87553461 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:49.274066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a1c2599f-a1ba-41f9-8d1c-0f4b87553461 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:49.282414 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a1c2599f-a1ba-41f9-8d1c-0f4b87553461 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1366 microversion: 2.1 time: 0.208189 Jun 07 13:17:49.283289 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 285/570] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:49 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:49.594390 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-b54fc239-1e73-4a62-a4c1-1ddd51b210e8 req-f7f2a434-8b39-47ec-beff-33b68b807701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5728ed-f056-462a-952e-ce2c4fd06b96", "name": "network-vif-plugged", "status": "completed", "tag": "03e4ee37-b76d-476a-8b2a-6aca0431452d"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:49.610089 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-b54fc239-1e73-4a62-a4c1-1ddd51b210e8 req-f7f2a434-8b39-47ec-beff-33b68b807701 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:49.613593 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-b54fc239-1e73-4a62-a4c1-1ddd51b210e8 req-f7f2a434-8b39-47ec-beff-33b68b807701 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:49.618189 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-30eccfd9-de8c-41a3-a0bd-107b45d69998 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:49.618973 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-30eccfd9-de8c-41a3-a0bd-107b45d69998 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:49.634354 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-30eccfd9-de8c-41a3-a0bd-107b45d69998 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:49.635192 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-30eccfd9-de8c-41a3-a0bd-107b45d69998 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:49.636176 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-30eccfd9-de8c-41a3-a0bd-107b45d69998 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:49.636773 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-30eccfd9-de8c-41a3-a0bd-107b45d69998 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:49.637935 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-b54fc239-1e73-4a62-a4c1-1ddd51b210e8 req-f7f2a434-8b39-47ec-beff-33b68b807701 service nova] Creating event network-vif-plugged:03e4ee37-b76d-476a-8b2a-6aca0431452d for instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 on hv-cinder-84496 Jun 07 13:17:49.645554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-b54fc239-1e73-4a62-a4c1-1ddd51b210e8 req-f7f2a434-8b39-47ec-beff-33b68b807701 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055348 Jun 07 13:17:49.646971 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 286/571] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:49.811114 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-30eccfd9-de8c-41a3-a0bd-107b45d69998 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:49.833247 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-30eccfd9-de8c-41a3-a0bd-107b45d69998 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1725 microversion: 2.1 time: 0.218672 Jun 07 13:17:49.835024 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 286/572] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:49 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:17:50.302023 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b9a5e34e-4150-46f8-8f78-de0fb2779e21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:50.303454 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b9a5e34e-4150-46f8-8f78-de0fb2779e21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:50.309921 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b9a5e34e-4150-46f8-8f78-de0fb2779e21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:50.312301 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b9a5e34e-4150-46f8-8f78-de0fb2779e21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:50.313607 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b9a5e34e-4150-46f8-8f78-de0fb2779e21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:50.314213 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b9a5e34e-4150-46f8-8f78-de0fb2779e21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:50.496581 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b9a5e34e-4150-46f8-8f78-de0fb2779e21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:50.504693 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b9a5e34e-4150-46f8-8f78-de0fb2779e21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1366 microversion: 2.1 time: 0.208687 Jun 07 13:17:50.505389 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 287/573] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:50 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:50.853350 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-63ec4d99-6e9c-41f1-b00d-ae713a2f00da tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:50.854732 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-63ec4d99-6e9c-41f1-b00d-ae713a2f00da tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:50.865858 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-63ec4d99-6e9c-41f1-b00d-ae713a2f00da tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:50.867228 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-63ec4d99-6e9c-41f1-b00d-ae713a2f00da tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:50.868993 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-63ec4d99-6e9c-41f1-b00d-ae713a2f00da tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:50.870049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-63ec4d99-6e9c-41f1-b00d-ae713a2f00da tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:51.066352 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-63ec4d99-6e9c-41f1-b00d-ae713a2f00da tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:51.075462 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-63ec4d99-6e9c-41f1-b00d-ae713a2f00da tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1725 microversion: 2.1 time: 0.227828 Jun 07 13:17:51.076621 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 287/574] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:50 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:51.524309 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-40e213e1-0e44-4db1-8317-76366a2b616a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:51.526395 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-40e213e1-0e44-4db1-8317-76366a2b616a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:51.536528 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-40e213e1-0e44-4db1-8317-76366a2b616a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:51.537396 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-40e213e1-0e44-4db1-8317-76366a2b616a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:51.540683 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-40e213e1-0e44-4db1-8317-76366a2b616a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:51.542334 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-40e213e1-0e44-4db1-8317-76366a2b616a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:51.775141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-40e213e1-0e44-4db1-8317-76366a2b616a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:51.785108 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-40e213e1-0e44-4db1-8317-76366a2b616a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1366 microversion: 2.1 time: 0.266855 Jun 07 13:17:51.786456 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 288/575] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:51 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:52.093266 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-73efaea1-9410-459c-9ee0-e99de9ffacd2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:52.094464 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-73efaea1-9410-459c-9ee0-e99de9ffacd2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:52.103447 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-73efaea1-9410-459c-9ee0-e99de9ffacd2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:52.105427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-73efaea1-9410-459c-9ee0-e99de9ffacd2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:52.106349 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-73efaea1-9410-459c-9ee0-e99de9ffacd2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:52.106853 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-73efaea1-9410-459c-9ee0-e99de9ffacd2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:52.287128 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-73efaea1-9410-459c-9ee0-e99de9ffacd2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:52.298072 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-73efaea1-9410-459c-9ee0-e99de9ffacd2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1725 microversion: 2.1 time: 0.207542 Jun 07 13:17:52.300544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 288/576] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:52 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:52.804260 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-51130f9a-f106-4a81-aa29-2b98c6bad07d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:52.806658 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-51130f9a-f106-4a81-aa29-2b98c6bad07d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:52.815863 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-51130f9a-f106-4a81-aa29-2b98c6bad07d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:52.816624 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-51130f9a-f106-4a81-aa29-2b98c6bad07d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:52.817586 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-51130f9a-f106-4a81-aa29-2b98c6bad07d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:52.818203 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-51130f9a-f106-4a81-aa29-2b98c6bad07d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:52.979352 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-51130f9a-f106-4a81-aa29-2b98c6bad07d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:52.988007 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-51130f9a-f106-4a81-aa29-2b98c6bad07d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1555 microversion: 2.1 time: 0.188304 Jun 07 13:17:52.989554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 289/577] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:52 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:53.006547 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-cf6c6b73-920f-4d56-8592-93070b399920 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:53.007031 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-cf6c6b73-920f-4d56-8592-93070b399920 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:53.013174 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cf6c6b73-920f-4d56-8592-93070b399920 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:53.013989 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cf6c6b73-920f-4d56-8592-93070b399920 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:53.014966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cf6c6b73-920f-4d56-8592-93070b399920 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:53.015582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cf6c6b73-920f-4d56-8592-93070b399920 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:53.119794 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-cf6c6b73-920f-4d56-8592-93070b399920 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114738 Jun 07 13:17:53.121643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 289/578] 10.222.0.58 () {58 vars in 1274 bytes} [Tue Jun 7 13:17:53 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:53.315966 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bd2cd8cf-ce85-4f16-a4f0-497ae71fcce4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:53.316494 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bd2cd8cf-ce85-4f16-a4f0-497ae71fcce4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:53.322993 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd2cd8cf-ce85-4f16-a4f0-497ae71fcce4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:53.323699 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd2cd8cf-ce85-4f16-a4f0-497ae71fcce4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:53.324712 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd2cd8cf-ce85-4f16-a4f0-497ae71fcce4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:53.325481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd2cd8cf-ce85-4f16-a4f0-497ae71fcce4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:53.841856 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bd2cd8cf-ce85-4f16-a4f0-497ae71fcce4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:53.854397 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bd2cd8cf-ce85-4f16-a4f0-497ae71fcce4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1725 microversion: 2.1 time: 0.542687 Jun 07 13:17:53.856828 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 290/579] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:53 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1725 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:54.507907 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-6cf3ff26-ad11-4728-a72d-a80ab742cef8 req-68a8269c-6592-446b-80d6-80325058a8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5728ed-f056-462a-952e-ce2c4fd06b96", "tag": "03e4ee37-b76d-476a-8b2a-6aca0431452d"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:54.519630 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-6cf3ff26-ad11-4728-a72d-a80ab742cef8 req-68a8269c-6592-446b-80d6-80325058a8d5 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:54.520327 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-6cf3ff26-ad11-4728-a72d-a80ab742cef8 req-68a8269c-6592-446b-80d6-80325058a8d5 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:54.536739 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-6cf3ff26-ad11-4728-a72d-a80ab742cef8 req-68a8269c-6592-446b-80d6-80325058a8d5 service nova] Creating event network-changed:03e4ee37-b76d-476a-8b2a-6aca0431452d for instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 on hv-cinder-84496 Jun 07 13:17:54.542251 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-6cf3ff26-ad11-4728-a72d-a80ab742cef8 req-68a8269c-6592-446b-80d6-80325058a8d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038765 Jun 07 13:17:54.543311 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 290/580] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:17:54.871973 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f5b11d16-75c8-4bfe-b975-1189565301bb tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:54.872459 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f5b11d16-75c8-4bfe-b975-1189565301bb tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:54.881317 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f5b11d16-75c8-4bfe-b975-1189565301bb tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:54.882058 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f5b11d16-75c8-4bfe-b975-1189565301bb tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:54.883049 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f5b11d16-75c8-4bfe-b975-1189565301bb tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:54.883725 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f5b11d16-75c8-4bfe-b975-1189565301bb tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:55.132557 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f5b11d16-75c8-4bfe-b975-1189565301bb tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:55.136160 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:55.149902 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f5b11d16-75c8-4bfe-b975-1189565301bb tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1725 microversion: 2.1 time: 0.281893 Jun 07 13:17:55.151563 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5e4db3fa-9200-410b-aa5f-1a9099679218 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:55.152324 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5e4db3fa-9200-410b-aa5f-1a9099679218 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:55.153175 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 291/581] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:54 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1725 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:55.163448 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5e4db3fa-9200-410b-aa5f-1a9099679218 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:55.165529 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5e4db3fa-9200-410b-aa5f-1a9099679218 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:55.166840 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5e4db3fa-9200-410b-aa5f-1a9099679218 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:55.168192 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5e4db3fa-9200-410b-aa5f-1a9099679218 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:55.197905 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5e4db3fa-9200-410b-aa5f-1a9099679218 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/ips" status: 200 len: 150 microversion: 2.20 time: 0.050988 Jun 07 13:17:55.199237 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 291/582] 10.222.0.58 () {60 vars in 1288 bytes} [Tue Jun 7 13:17:55 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/ips => generated 150 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:17:56.169247 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e4c3fa14-ea23-4f71-96c7-f31c36805a4d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:56.170146 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e4c3fa14-ea23-4f71-96c7-f31c36805a4d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:56.179245 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e4c3fa14-ea23-4f71-96c7-f31c36805a4d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:56.179993 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e4c3fa14-ea23-4f71-96c7-f31c36805a4d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:56.182102 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e4c3fa14-ea23-4f71-96c7-f31c36805a4d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:56.182849 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e4c3fa14-ea23-4f71-96c7-f31c36805a4d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:56.358531 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e4c3fa14-ea23-4f71-96c7-f31c36805a4d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:56.366921 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e4c3fa14-ea23-4f71-96c7-f31c36805a4d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1725 microversion: 2.1 time: 0.201457 Jun 07 13:17:56.368401 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 292/583] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:56 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:57.169903 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ad0a2509-f4f8-4fb5-8893-6dc6681864e7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:57.170432 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ad0a2509-f4f8-4fb5-8893-6dc6681864e7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:57.177180 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ad0a2509-f4f8-4fb5-8893-6dc6681864e7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:57.177624 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ad0a2509-f4f8-4fb5-8893-6dc6681864e7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:57.178372 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ad0a2509-f4f8-4fb5-8893-6dc6681864e7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:57.178850 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ad0a2509-f4f8-4fb5-8893-6dc6681864e7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:57.202580 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-ad0a2509-f4f8-4fb5-8893-6dc6681864e7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lazy-loading 'flavor' on Instance uuid 64eec94b-9fac-4ad4-8386-01a27db4d5ce {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:17:57.232687 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:57.385130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-30d8c5f9-4dcb-4a99-a84b-77996855001d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:57.386036 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-30d8c5f9-4dcb-4a99-a84b-77996855001d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:57.388727 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:57.397648 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-30d8c5f9-4dcb-4a99-a84b-77996855001d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:57.398101 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-30d8c5f9-4dcb-4a99-a84b-77996855001d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:57.398923 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-30d8c5f9-4dcb-4a99-a84b-77996855001d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:57.399589 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-30d8c5f9-4dcb-4a99-a84b-77996855001d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:57.524482 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ad0a2509-f4f8-4fb5-8893-6dc6681864e7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "POST /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/action" status: 202 len: 0 microversion: 2.20 time: 0.358402 Jun 07 13:17:57.525297 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 292/584] 10.222.0.58 () {62 vars in 1318 bytes} [Tue Jun 7 13:17:57 2022] POST /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:17:57.534586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b5a520a2-35e2-4178-b63a-d3cd2b7b96dc tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:57.535527 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b5a520a2-35e2-4178-b63a-d3cd2b7b96dc tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:57.544334 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b5a520a2-35e2-4178-b63a-d3cd2b7b96dc tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:57.545409 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b5a520a2-35e2-4178-b63a-d3cd2b7b96dc tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:57.546217 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b5a520a2-35e2-4178-b63a-d3cd2b7b96dc tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:57.546886 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b5a520a2-35e2-4178-b63a-d3cd2b7b96dc tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:57.572749 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-30d8c5f9-4dcb-4a99-a84b-77996855001d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:57.584679 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-30d8c5f9-4dcb-4a99-a84b-77996855001d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1725 microversion: 2.1 time: 0.203356 Jun 07 13:17:57.589345 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 293/585] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:57 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:57.699322 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b5a520a2-35e2-4178-b63a-d3cd2b7b96dc tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:57.710489 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b5a520a2-35e2-4178-b63a-d3cd2b7b96dc tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:57.712047 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b5a520a2-35e2-4178-b63a-d3cd2b7b96dc tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:57.713343 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b5a520a2-35e2-4178-b63a-d3cd2b7b96dc tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.183765 Jun 07 13:17:57.714144 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 293/586] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:17:57 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:17:58.422335 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c36b5c42-fe3c-4e10-9bc1-294693499083 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Action: 'create', calling method: .version_select at 0x7fb8e7759790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-656246516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5PCv06s3xEKPs+PnDn+m/Gth0kv+FU47PIPLb6gVoxSIrKDEhTSWtYgNbCpWUJaLHojM0aZJ05DZAnVAco4+gxHl1cfOHVuur6BN0pManT0VNryI9lSwwWS6ZJ9Q/09Q=="}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:58.436146 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-c36b5c42-fe3c-4e10-9bc1-294693499083 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Getting quotas for project fd9536c09221459485abe72ab8e43d99. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:17:58.439900 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-c36b5c42-fe3c-4e10-9bc1-294693499083 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Getting quotas for user f5c41cd95f8d4809803a6ab52ca9f714 and project fd9536c09221459485abe72ab8e43d99. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:17:58.461516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c36b5c42-fe3c-4e10-9bc1-294693499083 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.043103 Jun 07 13:17:58.462332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 294/587] 10.222.0.58 () {60 vars in 1158 bytes} [Tue Jun 7 13:17:58 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:58.510811 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-549b6990-3a96-432e-b195-67816b5d92fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1141117394", "imageRef": "86feb4f5-7864-4660-8bae-d24f95d3778e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-656246516", "networks": [{"uuid": "6e3fe6ba-1307-489a-a697-80af170eac0e"}]}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:58.559165 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.network.neutron [None req-549b6990-3a96-432e-b195-67816b5d92fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] validate_networks() for [('6e3fe6ba-1307-489a-a697-80af170eac0e', None, None, None, None, None)] {{(pid=117797) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:17:58.604690 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cecc46fa-dc4d-4120-a600-c0ed256766d6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:58.605294 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cecc46fa-dc4d-4120-a600-c0ed256766d6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:58.611231 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cecc46fa-dc4d-4120-a600-c0ed256766d6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:58.611677 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cecc46fa-dc4d-4120-a600-c0ed256766d6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:58.612428 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cecc46fa-dc4d-4120-a600-c0ed256766d6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:58.612859 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cecc46fa-dc4d-4120-a600-c0ed256766d6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:58.748393 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cecc46fa-dc4d-4120-a600-c0ed256766d6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:58.756560 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cecc46fa-dc4d-4120-a600-c0ed256766d6 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1725 microversion: 2.1 time: 0.155826 Jun 07 13:17:58.757127 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 295/588] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:58 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:17:58.763532 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-021bfa34-b968-4b8e-9a9f-8f94a6a05cb4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:58.763532 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-021bfa34-b968-4b8e-9a9f-8f94a6a05cb4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:58.768153 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-021bfa34-b968-4b8e-9a9f-8f94a6a05cb4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:58.768596 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-021bfa34-b968-4b8e-9a9f-8f94a6a05cb4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:58.769348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-021bfa34-b968-4b8e-9a9f-8f94a6a05cb4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:58.769776 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-021bfa34-b968-4b8e-9a9f-8f94a6a05cb4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:58.902241 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-021bfa34-b968-4b8e-9a9f-8f94a6a05cb4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:58.911616 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-021bfa34-b968-4b8e-9a9f-8f94a6a05cb4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:58.913147 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-021bfa34-b968-4b8e-9a9f-8f94a6a05cb4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:58.914308 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-021bfa34-b968-4b8e-9a9f-8f94a6a05cb4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.156268 Jun 07 13:17:58.914927 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 296/589] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:17:58 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:17:58.921990 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-549b6990-3a96-432e-b195-67816b5d92fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Flavor limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:17:58.922526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-549b6990-3a96-432e-b195-67816b5d92fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Image limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:17:58.923078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-549b6990-3a96-432e-b195-67816b5d92fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Flavor pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:17:58.923558 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-549b6990-3a96-432e-b195-67816b5d92fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Image pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:17:58.924041 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-549b6990-3a96-432e-b195-67816b5d92fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:17:58.933113 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-549b6990-3a96-432e-b195-67816b5d92fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:58.933554 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-549b6990-3a96-432e-b195-67816b5d92fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:58.934335 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-549b6990-3a96-432e-b195-67816b5d92fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:58.934821 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-549b6990-3a96-432e-b195-67816b5d92fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:58.951433 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-549b6990-3a96-432e-b195-67816b5d92fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Getting quotas for project fd9536c09221459485abe72ab8e43d99. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:17:58.955750 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-549b6990-3a96-432e-b195-67816b5d92fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Getting quotas for user f5c41cd95f8d4809803a6ab52ca9f714 and project fd9536c09221459485abe72ab8e43d99. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:17:58.966251 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-549b6990-3a96-432e-b195-67816b5d92fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Going to run 1 instances... {{(pid=117797) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:17:58.968395 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-549b6990-3a96-432e-b195-67816b5d92fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86feb4f5-7864-4660-8bae-d24f95d3778e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:17:59.012919 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-549b6990-3a96-432e-b195-67816b5d92fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505433 Jun 07 13:17:59.013324 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 294/590] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:17:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:17:59.023843 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1d8aee4f-f0ff-40cc-90ee-63e876bc402b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:59.024415 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1d8aee4f-f0ff-40cc-90ee-63e876bc402b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:59.079260 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1d8aee4f-f0ff-40cc-90ee-63e876bc402b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:59.085869 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1d8aee4f-f0ff-40cc-90ee-63e876bc402b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1258 microversion: 2.1 time: 0.066100 Jun 07 13:17:59.086670 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 297/591] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:59 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:17:59.773244 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-59bbef51-e881-4f7f-a62e-97469565f40c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:59.773779 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-59bbef51-e881-4f7f-a62e-97469565f40c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:59.779815 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-59bbef51-e881-4f7f-a62e-97469565f40c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:59.780255 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-59bbef51-e881-4f7f-a62e-97469565f40c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:59.781003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-59bbef51-e881-4f7f-a62e-97469565f40c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:59.781429 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-59bbef51-e881-4f7f-a62e-97469565f40c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:59.909957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-59bbef51-e881-4f7f-a62e-97469565f40c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:59.917863 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-59bbef51-e881-4f7f-a62e-97469565f40c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1702 microversion: 2.1 time: 0.148613 Jun 07 13:17:59.918507 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 295/592] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:59 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1702 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:59.932782 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bf53ab42-dd17-4d4e-8514-0b65eb13280d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:59.933446 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bf53ab42-dd17-4d4e-8514-0b65eb13280d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:59.941151 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf53ab42-dd17-4d4e-8514-0b65eb13280d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:59.941532 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8ed1530c-c9a2-4ce8-80e9-0ba150d87511 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:59.941670 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf53ab42-dd17-4d4e-8514-0b65eb13280d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:59.942353 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf53ab42-dd17-4d4e-8514-0b65eb13280d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:59.942952 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf53ab42-dd17-4d4e-8514-0b65eb13280d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:59.947544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8ed1530c-c9a2-4ce8-80e9-0ba150d87511 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:59.948036 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8ed1530c-c9a2-4ce8-80e9-0ba150d87511 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:59.969931 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8ed1530c-c9a2-4ce8-80e9-0ba150d87511 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Going to try to start instance {{(pid=117797) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 13:18:00.015459 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8ed1530c-c9a2-4ce8-80e9-0ba150d87511 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "POST /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/action" status: 202 len: 0 microversion: 2.1 time: 0.077796 Jun 07 13:18:00.016311 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 296/593] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jun 7 13:17:59 2022] POST /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:18:00.026282 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0a7b629e-7cd6-414d-a0d5-08fc761c104f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:00.027105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0a7b629e-7cd6-414d-a0d5-08fc761c104f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:00.036250 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0a7b629e-7cd6-414d-a0d5-08fc761c104f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:00.036684 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0a7b629e-7cd6-414d-a0d5-08fc761c104f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:00.037525 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0a7b629e-7cd6-414d-a0d5-08fc761c104f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:00.037933 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0a7b629e-7cd6-414d-a0d5-08fc761c104f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:00.099038 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bf53ab42-dd17-4d4e-8514-0b65eb13280d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:00.108569 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bf53ab42-dd17-4d4e-8514-0b65eb13280d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:00.110758 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bf53ab42-dd17-4d4e-8514-0b65eb13280d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:00.112206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bf53ab42-dd17-4d4e-8514-0b65eb13280d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.183344 Jun 07 13:18:00.113361 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 298/594] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:17:59 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:00.119884 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-536d8075-9bac-4828-b315-661570475fdf tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:00.120683 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-536d8075-9bac-4828-b315-661570475fdf tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:00.128611 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-536d8075-9bac-4828-b315-661570475fdf tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:00.129456 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-536d8075-9bac-4828-b315-661570475fdf tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:00.130243 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-536d8075-9bac-4828-b315-661570475fdf tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:00.130725 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-536d8075-9bac-4828-b315-661570475fdf tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:00.207458 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0a7b629e-7cd6-414d-a0d5-08fc761c104f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:00.218477 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0a7b629e-7cd6-414d-a0d5-08fc761c104f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1711 microversion: 2.1 time: 0.196244 Jun 07 13:18:00.219820 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 297/595] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:00 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1711 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:00.223427 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-536d8075-9bac-4828-b315-661570475fdf tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:00.234464 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-536d8075-9bac-4828-b315-661570475fdf tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1318 microversion: 2.1 time: 0.119397 Jun 07 13:18:00.235900 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 299/596] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:00 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1318 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:01.144103 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-68ab19b9-a782-45e9-a45d-2b27cb04a455 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:01.144844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-68ab19b9-a782-45e9-a45d-2b27cb04a455 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:01.153901 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-68ab19b9-a782-45e9-a45d-2b27cb04a455 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:01.154482 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-68ab19b9-a782-45e9-a45d-2b27cb04a455 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:01.155413 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-68ab19b9-a782-45e9-a45d-2b27cb04a455 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:01.156647 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-68ab19b9-a782-45e9-a45d-2b27cb04a455 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:01.237856 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c74e1080-2409-474f-b2d4-d5fd79a9cd53 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:01.239165 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c74e1080-2409-474f-b2d4-d5fd79a9cd53 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:01.253284 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c74e1080-2409-474f-b2d4-d5fd79a9cd53 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:01.254784 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c74e1080-2409-474f-b2d4-d5fd79a9cd53 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:01.258391 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c74e1080-2409-474f-b2d4-d5fd79a9cd53 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:01.259075 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c74e1080-2409-474f-b2d4-d5fd79a9cd53 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:01.367227 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-68ab19b9-a782-45e9-a45d-2b27cb04a455 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:01.377029 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-68ab19b9-a782-45e9-a45d-2b27cb04a455 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:01.379043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-68ab19b9-a782-45e9-a45d-2b27cb04a455 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:01.380836 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-68ab19b9-a782-45e9-a45d-2b27cb04a455 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.242156 Jun 07 13:18:01.381660 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 298/597] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:01 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:01.386301 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-14676140-d2b0-4fd8-beb8-1d0af920f7a4 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:01.387135 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-14676140-d2b0-4fd8-beb8-1d0af920f7a4 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:01.394390 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-14676140-d2b0-4fd8-beb8-1d0af920f7a4 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:01.395179 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-14676140-d2b0-4fd8-beb8-1d0af920f7a4 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:01.396271 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-14676140-d2b0-4fd8-beb8-1d0af920f7a4 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:01.396936 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-14676140-d2b0-4fd8-beb8-1d0af920f7a4 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:01.457760 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c74e1080-2409-474f-b2d4-d5fd79a9cd53 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:01.467299 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c74e1080-2409-474f-b2d4-d5fd79a9cd53 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1711 microversion: 2.1 time: 0.235106 Jun 07 13:18:01.471337 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 300/598] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:01 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1711 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:01.561291 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-14676140-d2b0-4fd8-beb8-1d0af920f7a4 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:01.581070 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-14676140-d2b0-4fd8-beb8-1d0af920f7a4 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.198165 Jun 07 13:18:01.591766 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 299/599] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:01 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:02.400853 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-599f6a21-efbb-457e-a2ff-a94c2d955cce tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:02.401466 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-599f6a21-efbb-457e-a2ff-a94c2d955cce tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:02.408679 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-599f6a21-efbb-457e-a2ff-a94c2d955cce tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:02.409128 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-599f6a21-efbb-457e-a2ff-a94c2d955cce tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:02.409886 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-599f6a21-efbb-457e-a2ff-a94c2d955cce tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:02.410322 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-599f6a21-efbb-457e-a2ff-a94c2d955cce tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:02.488695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-903fea76-1ffe-4bc8-9016-21b338dd0475 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:02.489345 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-903fea76-1ffe-4bc8-9016-21b338dd0475 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:02.495373 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-903fea76-1ffe-4bc8-9016-21b338dd0475 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:02.495819 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-903fea76-1ffe-4bc8-9016-21b338dd0475 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:02.496772 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-903fea76-1ffe-4bc8-9016-21b338dd0475 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:02.497203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-903fea76-1ffe-4bc8-9016-21b338dd0475 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:02.559163 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-599f6a21-efbb-457e-a2ff-a94c2d955cce tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:02.566998 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-599f6a21-efbb-457e-a2ff-a94c2d955cce tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:02.568508 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-599f6a21-efbb-457e-a2ff-a94c2d955cce tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:02.569656 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-599f6a21-efbb-457e-a2ff-a94c2d955cce tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.172725 Jun 07 13:18:02.570212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 301/600] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:02 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:02.607801 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e791a103-feef-4b3f-9d3a-ff0fe3cb830e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:02.608417 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e791a103-feef-4b3f-9d3a-ff0fe3cb830e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:02.615439 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e791a103-feef-4b3f-9d3a-ff0fe3cb830e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:02.616164 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e791a103-feef-4b3f-9d3a-ff0fe3cb830e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:02.617093 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e791a103-feef-4b3f-9d3a-ff0fe3cb830e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:02.617699 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e791a103-feef-4b3f-9d3a-ff0fe3cb830e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:02.638493 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-903fea76-1ffe-4bc8-9016-21b338dd0475 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:02.648385 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-903fea76-1ffe-4bc8-9016-21b338dd0475 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1711 microversion: 2.1 time: 0.164088 Jun 07 13:18:02.649316 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 300/601] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:02 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1711 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:02.755266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e791a103-feef-4b3f-9d3a-ff0fe3cb830e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:02.764703 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e791a103-feef-4b3f-9d3a-ff0fe3cb830e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.160688 Jun 07 13:18:02.765287 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 302/602] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:02 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:03.592800 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c33b2339-edf3-4e4d-ad1d-9a0d05f0ce27 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:03.593438 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c33b2339-edf3-4e4d-ad1d-9a0d05f0ce27 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:03.595482 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:03.601220 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c33b2339-edf3-4e4d-ad1d-9a0d05f0ce27 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:03.601805 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c33b2339-edf3-4e4d-ad1d-9a0d05f0ce27 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:03.602648 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c33b2339-edf3-4e4d-ad1d-9a0d05f0ce27 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:03.603087 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c33b2339-edf3-4e4d-ad1d-9a0d05f0ce27 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:03.666550 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2a79e31a-e66d-46ff-adf0-25dbbaf8a8dd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:03.667160 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2a79e31a-e66d-46ff-adf0-25dbbaf8a8dd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:03.674099 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2a79e31a-e66d-46ff-adf0-25dbbaf8a8dd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:03.674577 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2a79e31a-e66d-46ff-adf0-25dbbaf8a8dd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:03.675355 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2a79e31a-e66d-46ff-adf0-25dbbaf8a8dd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:03.675795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2a79e31a-e66d-46ff-adf0-25dbbaf8a8dd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:03.757468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c33b2339-edf3-4e4d-ad1d-9a0d05f0ce27 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:03.766162 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c33b2339-edf3-4e4d-ad1d-9a0d05f0ce27 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:03.767699 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c33b2339-edf3-4e4d-ad1d-9a0d05f0ce27 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:03.768848 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c33b2339-edf3-4e4d-ad1d-9a0d05f0ce27 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.180022 Jun 07 13:18:03.779561 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 301/603] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:03 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:03.780786 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-35f0de3e-574d-40f1-bd1d-1972789e2720 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:03.781399 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-35f0de3e-574d-40f1-bd1d-1972789e2720 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:03.789069 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-35f0de3e-574d-40f1-bd1d-1972789e2720 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:03.789572 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-35f0de3e-574d-40f1-bd1d-1972789e2720 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:03.790347 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-35f0de3e-574d-40f1-bd1d-1972789e2720 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:03.790811 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-35f0de3e-574d-40f1-bd1d-1972789e2720 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:03.830060 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2a79e31a-e66d-46ff-adf0-25dbbaf8a8dd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:03.838750 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2a79e31a-e66d-46ff-adf0-25dbbaf8a8dd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1711 microversion: 2.1 time: 0.176045 Jun 07 13:18:03.839328 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 303/604] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:03 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1711 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:03.920819 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-35f0de3e-574d-40f1-bd1d-1972789e2720 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:03.929758 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-35f0de3e-574d-40f1-bd1d-1972789e2720 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.152553 Jun 07 13:18:03.935280 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 302/605] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:03 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:04.787588 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-64b2ab01-d44d-4899-91e2-3a4a6ce01dee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:04.788288 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-64b2ab01-d44d-4899-91e2-3a4a6ce01dee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:04.794887 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64b2ab01-d44d-4899-91e2-3a4a6ce01dee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:04.795333 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64b2ab01-d44d-4899-91e2-3a4a6ce01dee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:04.796095 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64b2ab01-d44d-4899-91e2-3a4a6ce01dee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:04.796528 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64b2ab01-d44d-4899-91e2-3a4a6ce01dee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:04.855978 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f78cc744-c0d1-43bf-85a4-f6919ed312cc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:04.856592 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f78cc744-c0d1-43bf-85a4-f6919ed312cc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:04.863099 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f78cc744-c0d1-43bf-85a4-f6919ed312cc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:04.863551 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f78cc744-c0d1-43bf-85a4-f6919ed312cc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:04.864319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f78cc744-c0d1-43bf-85a4-f6919ed312cc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:04.864754 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f78cc744-c0d1-43bf-85a4-f6919ed312cc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:04.960312 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-64b2ab01-d44d-4899-91e2-3a4a6ce01dee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:04.969017 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-64b2ab01-d44d-4899-91e2-3a4a6ce01dee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:04.970678 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-64b2ab01-d44d-4899-91e2-3a4a6ce01dee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:04.971944 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-64b2ab01-d44d-4899-91e2-3a4a6ce01dee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.188331 Jun 07 13:18:04.972576 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 304/606] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:04 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:18:04.978565 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d4c25612-35ac-413a-a9de-ecc2c6bd4d3b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:04.978565 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d4c25612-35ac-413a-a9de-ecc2c6bd4d3b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:04.983981 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d4c25612-35ac-413a-a9de-ecc2c6bd4d3b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:04.984507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d4c25612-35ac-413a-a9de-ecc2c6bd4d3b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:04.985875 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d4c25612-35ac-413a-a9de-ecc2c6bd4d3b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:04.986395 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d4c25612-35ac-413a-a9de-ecc2c6bd4d3b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:05.021989 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f78cc744-c0d1-43bf-85a4-f6919ed312cc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:05.029922 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f78cc744-c0d1-43bf-85a4-f6919ed312cc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1711 microversion: 2.1 time: 0.177774 Jun 07 13:18:05.030516 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 303/607] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:04 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1711 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:05.121048 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d4c25612-35ac-413a-a9de-ecc2c6bd4d3b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:05.129181 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d4c25612-35ac-413a-a9de-ecc2c6bd4d3b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.155591 Jun 07 13:18:05.129751 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 305/608] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:04 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:05.989982 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9937ae52-63a0-4950-a124-d496f65889f2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:05.990720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9937ae52-63a0-4950-a124-d496f65889f2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:05.996587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9937ae52-63a0-4950-a124-d496f65889f2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:05.997034 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9937ae52-63a0-4950-a124-d496f65889f2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:05.997783 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9937ae52-63a0-4950-a124-d496f65889f2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:05.998212 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9937ae52-63a0-4950-a124-d496f65889f2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:06.046999 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-64339b74-6905-44c7-a639-8fbca4c7ab48 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:06.047749 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-64339b74-6905-44c7-a639-8fbca4c7ab48 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:06.061114 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64339b74-6905-44c7-a639-8fbca4c7ab48 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:06.061114 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64339b74-6905-44c7-a639-8fbca4c7ab48 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:06.061114 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64339b74-6905-44c7-a639-8fbca4c7ab48 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:06.061114 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64339b74-6905-44c7-a639-8fbca4c7ab48 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:06.193396 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9937ae52-63a0-4950-a124-d496f65889f2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:06.202142 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9937ae52-63a0-4950-a124-d496f65889f2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:06.203665 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9937ae52-63a0-4950-a124-d496f65889f2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:06.204801 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9937ae52-63a0-4950-a124-d496f65889f2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.218719 Jun 07 13:18:06.205353 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 304/609] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:05 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:06.210006 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-bbf807e7-1610-4e65-8a40-ccd9cbb8e897 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:06.210683 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-bbf807e7-1610-4e65-8a40-ccd9cbb8e897 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:06.217012 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bbf807e7-1610-4e65-8a40-ccd9cbb8e897 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:06.217750 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bbf807e7-1610-4e65-8a40-ccd9cbb8e897 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:06.218546 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bbf807e7-1610-4e65-8a40-ccd9cbb8e897 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:06.219468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bbf807e7-1610-4e65-8a40-ccd9cbb8e897 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:06.251794 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-64339b74-6905-44c7-a639-8fbca4c7ab48 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:06.260467 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-64339b74-6905-44c7-a639-8fbca4c7ab48 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1711 microversion: 2.1 time: 0.217215 Jun 07 13:18:06.261061 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 306/610] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:06 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1711 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:06.362146 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-bbf807e7-1610-4e65-8a40-ccd9cbb8e897 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:06.369645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-bbf807e7-1610-4e65-8a40-ccd9cbb8e897 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.163361 Jun 07 13:18:06.370214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 305/611] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:06 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:07.222794 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-23bb2a1e-ad90-44c5-b60e-7aeeb66ce3d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:07.223370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-23bb2a1e-ad90-44c5-b60e-7aeeb66ce3d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:07.229705 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-23bb2a1e-ad90-44c5-b60e-7aeeb66ce3d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:07.230153 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-23bb2a1e-ad90-44c5-b60e-7aeeb66ce3d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:07.230938 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-23bb2a1e-ad90-44c5-b60e-7aeeb66ce3d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:07.231381 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-23bb2a1e-ad90-44c5-b60e-7aeeb66ce3d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:07.277300 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b2d2b2f7-66d1-4942-95f9-1f3f6f44441a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:07.278679 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b2d2b2f7-66d1-4942-95f9-1f3f6f44441a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:07.285391 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b2d2b2f7-66d1-4942-95f9-1f3f6f44441a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:07.285845 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b2d2b2f7-66d1-4942-95f9-1f3f6f44441a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:07.286650 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b2d2b2f7-66d1-4942-95f9-1f3f6f44441a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:07.287293 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b2d2b2f7-66d1-4942-95f9-1f3f6f44441a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:07.368973 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-23bb2a1e-ad90-44c5-b60e-7aeeb66ce3d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:07.377076 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-23bb2a1e-ad90-44c5-b60e-7aeeb66ce3d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:07.378632 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-23bb2a1e-ad90-44c5-b60e-7aeeb66ce3d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:07.379801 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-23bb2a1e-ad90-44c5-b60e-7aeeb66ce3d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.161032 Jun 07 13:18:07.380671 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 307/612] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:07 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:07.385019 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fb05d19c-9ff7-4834-8bca-c92b0680b1fe tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:07.385625 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fb05d19c-9ff7-4834-8bca-c92b0680b1fe tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:07.392220 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb05d19c-9ff7-4834-8bca-c92b0680b1fe tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:07.392671 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb05d19c-9ff7-4834-8bca-c92b0680b1fe tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:07.393437 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb05d19c-9ff7-4834-8bca-c92b0680b1fe tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:07.393876 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb05d19c-9ff7-4834-8bca-c92b0680b1fe tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:07.432009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b2d2b2f7-66d1-4942-95f9-1f3f6f44441a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:07.440904 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b2d2b2f7-66d1-4942-95f9-1f3f6f44441a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1711 microversion: 2.1 time: 0.167671 Jun 07 13:18:07.441508 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 306/613] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:07 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1711 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:07.526851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fb05d19c-9ff7-4834-8bca-c92b0680b1fe tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:07.534656 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fb05d19c-9ff7-4834-8bca-c92b0680b1fe tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.152992 Jun 07 13:18:07.535226 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 308/614] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:07 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:08.397095 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-2e7638f2-e775-44d5-8dd0-e37538207c48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:08.397656 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-2e7638f2-e775-44d5-8dd0-e37538207c48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:08.403841 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2e7638f2-e775-44d5-8dd0-e37538207c48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:08.404330 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2e7638f2-e775-44d5-8dd0-e37538207c48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:08.405115 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2e7638f2-e775-44d5-8dd0-e37538207c48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:08.405580 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2e7638f2-e775-44d5-8dd0-e37538207c48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:08.458166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c90a76b6-c4fd-436c-a5bc-abd98960cf72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:08.458891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c90a76b6-c4fd-436c-a5bc-abd98960cf72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:08.467444 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c90a76b6-c4fd-436c-a5bc-abd98960cf72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:08.468324 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c90a76b6-c4fd-436c-a5bc-abd98960cf72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:08.469895 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c90a76b6-c4fd-436c-a5bc-abd98960cf72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:08.470588 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c90a76b6-c4fd-436c-a5bc-abd98960cf72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:08.557221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-2e7638f2-e775-44d5-8dd0-e37538207c48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:08.560682 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:08.566668 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-2e7638f2-e775-44d5-8dd0-e37538207c48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:08.568192 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-2e7638f2-e775-44d5-8dd0-e37538207c48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:08.569337 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-2e7638f2-e775-44d5-8dd0-e37538207c48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.176171 Jun 07 13:18:08.570113 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 307/615] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:08 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:08.574417 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8b01cd12-80ed-481a-93cb-3e30744bf3df tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:08.575039 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8b01cd12-80ed-481a-93cb-3e30744bf3df tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:08.582410 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8b01cd12-80ed-481a-93cb-3e30744bf3df tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:08.583012 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8b01cd12-80ed-481a-93cb-3e30744bf3df tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:08.583807 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8b01cd12-80ed-481a-93cb-3e30744bf3df tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:08.584237 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8b01cd12-80ed-481a-93cb-3e30744bf3df tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:08.607525 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c90a76b6-c4fd-436c-a5bc-abd98960cf72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:08.615729 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c90a76b6-c4fd-436c-a5bc-abd98960cf72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1711 microversion: 2.1 time: 0.162432 Jun 07 13:18:08.616309 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 309/616] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:08 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1711 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:08.717025 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8b01cd12-80ed-481a-93cb-3e30744bf3df tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:08.725950 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8b01cd12-80ed-481a-93cb-3e30744bf3df tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.155017 Jun 07 13:18:08.726702 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 308/617] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:08 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:09.588241 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cc04bf1c-e75b-48e8-9616-a98da13b12e9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:09.588854 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cc04bf1c-e75b-48e8-9616-a98da13b12e9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:09.590727 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:09.597106 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cc04bf1c-e75b-48e8-9616-a98da13b12e9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:09.597566 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cc04bf1c-e75b-48e8-9616-a98da13b12e9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:09.598338 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cc04bf1c-e75b-48e8-9616-a98da13b12e9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:09.598790 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cc04bf1c-e75b-48e8-9616-a98da13b12e9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:09.616969 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:09.632454 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-36a09484-55d2-45df-980b-6373c70a7692 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:09.633065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-36a09484-55d2-45df-980b-6373c70a7692 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:09.651357 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=2 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:09.652362 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=6 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:09.655268 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-36a09484-55d2-45df-980b-6373c70a7692 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:09.655764 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-36a09484-55d2-45df-980b-6373c70a7692 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:09.656643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-36a09484-55d2-45df-980b-6373c70a7692 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:09.658268 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-36a09484-55d2-45df-980b-6373c70a7692 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:09.749258 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cc04bf1c-e75b-48e8-9616-a98da13b12e9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:09.757819 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cc04bf1c-e75b-48e8-9616-a98da13b12e9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:09.759332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cc04bf1c-e75b-48e8-9616-a98da13b12e9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:09.760478 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cc04bf1c-e75b-48e8-9616-a98da13b12e9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.176174 Jun 07 13:18:09.761355 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 310/618] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:09 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:09.766051 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-af68a457-c2f7-43ff-86af-1718dc273b0c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:09.767172 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-af68a457-c2f7-43ff-86af-1718dc273b0c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:09.773120 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-af68a457-c2f7-43ff-86af-1718dc273b0c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:09.773899 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-af68a457-c2f7-43ff-86af-1718dc273b0c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:09.774692 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-af68a457-c2f7-43ff-86af-1718dc273b0c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:09.775122 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-af68a457-c2f7-43ff-86af-1718dc273b0c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:09.815753 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-36a09484-55d2-45df-980b-6373c70a7692 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:09.838357 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-36a09484-55d2-45df-980b-6373c70a7692 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1711 microversion: 2.1 time: 0.209511 Jun 07 13:18:09.843415 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 309/619] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:09 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1711 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:09.925557 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-af68a457-c2f7-43ff-86af-1718dc273b0c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:09.933287 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-af68a457-c2f7-43ff-86af-1718dc273b0c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.170931 Jun 07 13:18:09.933860 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 311/620] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:09 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:10.779684 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-26159f39-1e56-4046-a4e2-226a8d6c5c4c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:10.780240 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-26159f39-1e56-4046-a4e2-226a8d6c5c4c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:10.786945 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-26159f39-1e56-4046-a4e2-226a8d6c5c4c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:10.787382 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-26159f39-1e56-4046-a4e2-226a8d6c5c4c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:10.788124 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-26159f39-1e56-4046-a4e2-226a8d6c5c4c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:10.788559 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-26159f39-1e56-4046-a4e2-226a8d6c5c4c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:10.855453 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f17390ee-f1ff-4045-93fe-5467c9a4a77b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:10.856159 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f17390ee-f1ff-4045-93fe-5467c9a4a77b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:10.862699 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f17390ee-f1ff-4045-93fe-5467c9a4a77b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:10.863331 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f17390ee-f1ff-4045-93fe-5467c9a4a77b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:10.863902 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f17390ee-f1ff-4045-93fe-5467c9a4a77b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:10.864342 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f17390ee-f1ff-4045-93fe-5467c9a4a77b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:10.924628 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-26159f39-1e56-4046-a4e2-226a8d6c5c4c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:10.933346 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-26159f39-1e56-4046-a4e2-226a8d6c5c4c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:10.935593 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-26159f39-1e56-4046-a4e2-226a8d6c5c4c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:10.936965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-26159f39-1e56-4046-a4e2-226a8d6c5c4c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.161280 Jun 07 13:18:10.938004 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 310/621] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:10 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:10.954767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c705b534-7c95-40a1-9249-72a2c934ed6e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:10.955640 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c705b534-7c95-40a1-9249-72a2c934ed6e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:10.962121 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c705b534-7c95-40a1-9249-72a2c934ed6e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:10.962471 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c705b534-7c95-40a1-9249-72a2c934ed6e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:10.963247 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c705b534-7c95-40a1-9249-72a2c934ed6e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:10.963686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c705b534-7c95-40a1-9249-72a2c934ed6e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:11.028138 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f17390ee-f1ff-4045-93fe-5467c9a4a77b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:11.038212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f17390ee-f1ff-4045-93fe-5467c9a4a77b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1711 microversion: 2.1 time: 0.186380 Jun 07 13:18:11.039264 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 312/622] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:10 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1711 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:11.103482 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c705b534-7c95-40a1-9249-72a2c934ed6e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:11.111646 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c705b534-7c95-40a1-9249-72a2c934ed6e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.161187 Jun 07 13:18:11.112400 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 311/623] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:10 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:11.955377 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1249f158-f5b2-4483-b806-41cc60b2bfc1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:11.955997 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1249f158-f5b2-4483-b806-41cc60b2bfc1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:11.962118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1249f158-f5b2-4483-b806-41cc60b2bfc1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:11.962601 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1249f158-f5b2-4483-b806-41cc60b2bfc1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:11.963355 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1249f158-f5b2-4483-b806-41cc60b2bfc1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:11.963786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1249f158-f5b2-4483-b806-41cc60b2bfc1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:12.056045 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-78a850f4-28af-470b-9134-cb78d2da83ae tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:12.057604 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-78a850f4-28af-470b-9134-cb78d2da83ae tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:12.066137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-78a850f4-28af-470b-9134-cb78d2da83ae tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:12.066631 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-78a850f4-28af-470b-9134-cb78d2da83ae tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:12.067419 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-78a850f4-28af-470b-9134-cb78d2da83ae tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:12.067864 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-78a850f4-28af-470b-9134-cb78d2da83ae tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:12.111017 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1249f158-f5b2-4483-b806-41cc60b2bfc1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:12.123018 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1249f158-f5b2-4483-b806-41cc60b2bfc1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:12.125699 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1249f158-f5b2-4483-b806-41cc60b2bfc1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:12.127135 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1249f158-f5b2-4483-b806-41cc60b2bfc1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.175634 Jun 07 13:18:12.130695 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 313/624] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:11 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:12.132413 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9efec6d8-9dac-45ad-a172-a24bda175b58 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:12.133020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9efec6d8-9dac-45ad-a172-a24bda175b58 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:12.139258 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9efec6d8-9dac-45ad-a172-a24bda175b58 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:12.139705 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9efec6d8-9dac-45ad-a172-a24bda175b58 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:12.140471 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9efec6d8-9dac-45ad-a172-a24bda175b58 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:12.140937 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9efec6d8-9dac-45ad-a172-a24bda175b58 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:12.224667 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-78a850f4-28af-470b-9134-cb78d2da83ae tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:12.232715 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-78a850f4-28af-470b-9134-cb78d2da83ae tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1711 microversion: 2.1 time: 0.180532 Jun 07 13:18:12.242634 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 312/625] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:12 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1711 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:12.266831 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9efec6d8-9dac-45ad-a172-a24bda175b58 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:12.274374 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9efec6d8-9dac-45ad-a172-a24bda175b58 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.145728 Jun 07 13:18:12.275006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 314/626] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:12 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:13.145858 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-57525e92-bfe6-406b-8d38-eed9ae5cdabe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:13.146820 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-57525e92-bfe6-406b-8d38-eed9ae5cdabe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:13.153121 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-57525e92-bfe6-406b-8d38-eed9ae5cdabe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.153595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-57525e92-bfe6-406b-8d38-eed9ae5cdabe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.154354 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-57525e92-bfe6-406b-8d38-eed9ae5cdabe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.154812 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-57525e92-bfe6-406b-8d38-eed9ae5cdabe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.249901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8a616a43-9584-4cb8-87ff-0bfa8a512855 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:13.250594 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8a616a43-9584-4cb8-87ff-0bfa8a512855 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:13.256988 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a616a43-9584-4cb8-87ff-0bfa8a512855 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.257446 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a616a43-9584-4cb8-87ff-0bfa8a512855 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.258213 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a616a43-9584-4cb8-87ff-0bfa8a512855 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.258710 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a616a43-9584-4cb8-87ff-0bfa8a512855 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.289413 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-57525e92-bfe6-406b-8d38-eed9ae5cdabe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:13.297558 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-57525e92-bfe6-406b-8d38-eed9ae5cdabe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:13.299126 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-57525e92-bfe6-406b-8d38-eed9ae5cdabe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:13.300288 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-57525e92-bfe6-406b-8d38-eed9ae5cdabe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.158393 Jun 07 13:18:13.300855 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 313/627] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:13 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:13.305395 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-48f7a172-6a70-4973-a0b1-6ce31ef7a5c2 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:13.306007 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-48f7a172-6a70-4973-a0b1-6ce31ef7a5c2 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:13.312065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-48f7a172-6a70-4973-a0b1-6ce31ef7a5c2 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.312513 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-48f7a172-6a70-4973-a0b1-6ce31ef7a5c2 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.313374 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-48f7a172-6a70-4973-a0b1-6ce31ef7a5c2 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.313813 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-48f7a172-6a70-4973-a0b1-6ce31ef7a5c2 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.391833 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8a616a43-9584-4cb8-87ff-0bfa8a512855 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:13.401313 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8a616a43-9584-4cb8-87ff-0bfa8a512855 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1711 microversion: 2.1 time: 0.154895 Jun 07 13:18:13.411734 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 315/628] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:13 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1711 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:13.445603 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-48f7a172-6a70-4973-a0b1-6ce31ef7a5c2 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:13.452990 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-48f7a172-6a70-4973-a0b1-6ce31ef7a5c2 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.151198 Jun 07 13:18:13.454184 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 314/629] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:13 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:14.318170 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7931fab9-814c-4ee6-8d36-4d13db7782db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:14.318725 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7931fab9-814c-4ee6-8d36-4d13db7782db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:14.325169 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7931fab9-814c-4ee6-8d36-4d13db7782db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:14.325616 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7931fab9-814c-4ee6-8d36-4d13db7782db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:14.326375 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7931fab9-814c-4ee6-8d36-4d13db7782db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:14.326838 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7931fab9-814c-4ee6-8d36-4d13db7782db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:14.419670 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-fc9e826c-d017-46a5-8059-92b6dfe49904 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:14.420390 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-fc9e826c-d017-46a5-8059-92b6dfe49904 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:14.426931 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fc9e826c-d017-46a5-8059-92b6dfe49904 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:14.427456 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fc9e826c-d017-46a5-8059-92b6dfe49904 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:14.428227 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fc9e826c-d017-46a5-8059-92b6dfe49904 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:14.428662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fc9e826c-d017-46a5-8059-92b6dfe49904 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:14.455939 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7931fab9-814c-4ee6-8d36-4d13db7782db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:14.463893 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7931fab9-814c-4ee6-8d36-4d13db7782db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:14.465387 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7931fab9-814c-4ee6-8d36-4d13db7782db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:14.466565 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7931fab9-814c-4ee6-8d36-4d13db7782db tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.152381 Jun 07 13:18:14.467771 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 316/630] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:14 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:14.472026 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-80cb742e-d326-492a-8c47-d9e4276b539a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:14.472624 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-80cb742e-d326-492a-8c47-d9e4276b539a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:14.478728 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-80cb742e-d326-492a-8c47-d9e4276b539a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:14.479172 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-80cb742e-d326-492a-8c47-d9e4276b539a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:14.480033 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-80cb742e-d326-492a-8c47-d9e4276b539a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:14.480491 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-80cb742e-d326-492a-8c47-d9e4276b539a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:14.558509 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-fc9e826c-d017-46a5-8059-92b6dfe49904 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:14.567424 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-fc9e826c-d017-46a5-8059-92b6dfe49904 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1711 microversion: 2.1 time: 0.151482 Jun 07 13:18:14.568000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 315/631] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:14 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1711 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:14.605909 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-80cb742e-d326-492a-8c47-d9e4276b539a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:14.614255 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-80cb742e-d326-492a-8c47-d9e4276b539a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.146178 Jun 07 13:18:14.614840 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 317/632] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:14 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:15.485477 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a53cc281-cf58-4f3f-bd66-7ea9f0a3581b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:15.486071 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a53cc281-cf58-4f3f-bd66-7ea9f0a3581b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:15.492008 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a53cc281-cf58-4f3f-bd66-7ea9f0a3581b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:15.492442 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a53cc281-cf58-4f3f-bd66-7ea9f0a3581b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:15.493182 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a53cc281-cf58-4f3f-bd66-7ea9f0a3581b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:15.493606 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a53cc281-cf58-4f3f-bd66-7ea9f0a3581b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:15.583918 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cc71e448-7af5-40ee-908e-2e4792dc071c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:15.584530 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cc71e448-7af5-40ee-908e-2e4792dc071c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:15.590997 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cc71e448-7af5-40ee-908e-2e4792dc071c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:15.591447 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cc71e448-7af5-40ee-908e-2e4792dc071c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:15.592214 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cc71e448-7af5-40ee-908e-2e4792dc071c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:15.592651 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cc71e448-7af5-40ee-908e-2e4792dc071c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:15.625039 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a53cc281-cf58-4f3f-bd66-7ea9f0a3581b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:15.634192 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a53cc281-cf58-4f3f-bd66-7ea9f0a3581b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:15.635780 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a53cc281-cf58-4f3f-bd66-7ea9f0a3581b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:15.636933 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a53cc281-cf58-4f3f-bd66-7ea9f0a3581b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.155806 Jun 07 13:18:15.637495 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 316/633] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:15 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:15.641824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3099509b-92ad-4564-a7ff-e24798782c2c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:15.642453 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3099509b-92ad-4564-a7ff-e24798782c2c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:15.648224 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3099509b-92ad-4564-a7ff-e24798782c2c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:15.648668 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3099509b-92ad-4564-a7ff-e24798782c2c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:15.649419 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3099509b-92ad-4564-a7ff-e24798782c2c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:15.649846 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3099509b-92ad-4564-a7ff-e24798782c2c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:15.724998 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cc71e448-7af5-40ee-908e-2e4792dc071c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:15.733279 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cc71e448-7af5-40ee-908e-2e4792dc071c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1711 microversion: 2.1 time: 0.153131 Jun 07 13:18:15.733876 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 318/634] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:15 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1711 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:15.775850 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3099509b-92ad-4564-a7ff-e24798782c2c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:15.783942 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3099509b-92ad-4564-a7ff-e24798782c2c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.145514 Jun 07 13:18:15.784502 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 317/635] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:15 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:16.654832 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b0acd05a-2a5a-4673-8006-a270d1744e80 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:16.655584 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b0acd05a-2a5a-4673-8006-a270d1744e80 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:16.662491 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b0acd05a-2a5a-4673-8006-a270d1744e80 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:16.662953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b0acd05a-2a5a-4673-8006-a270d1744e80 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:16.663725 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b0acd05a-2a5a-4673-8006-a270d1744e80 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:16.664160 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b0acd05a-2a5a-4673-8006-a270d1744e80 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:16.751507 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-32d811f8-56f1-467e-9c21-86a2d0472837 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:16.752294 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-32d811f8-56f1-467e-9c21-86a2d0472837 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:16.758324 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-32d811f8-56f1-467e-9c21-86a2d0472837 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:16.758807 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-32d811f8-56f1-467e-9c21-86a2d0472837 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:16.759577 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-32d811f8-56f1-467e-9c21-86a2d0472837 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:16.760012 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-32d811f8-56f1-467e-9c21-86a2d0472837 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:16.902616 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-32d811f8-56f1-467e-9c21-86a2d0472837 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:16.911336 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-32d811f8-56f1-467e-9c21-86a2d0472837 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1711 microversion: 2.1 time: 0.164498 Jun 07 13:18:16.911830 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 318/636] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:16 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1711 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:16.916311 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-97cac035-30eb-4509-8626-fa1a982f9924 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:16.916909 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-97cac035-30eb-4509-8626-fa1a982f9924 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:16.923647 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-97cac035-30eb-4509-8626-fa1a982f9924 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:16.924099 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-97cac035-30eb-4509-8626-fa1a982f9924 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:16.924859 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-97cac035-30eb-4509-8626-fa1a982f9924 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:16.925286 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-97cac035-30eb-4509-8626-fa1a982f9924 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:17.054155 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-97cac035-30eb-4509-8626-fa1a982f9924 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:17.061667 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-97cac035-30eb-4509-8626-fa1a982f9924 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.148874 Jun 07 13:18:17.062237 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 319/637] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:16 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:17.138598 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b0acd05a-2a5a-4673-8006-a270d1744e80 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:17.146573 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b0acd05a-2a5a-4673-8006-a270d1744e80 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:17.148076 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b0acd05a-2a5a-4673-8006-a270d1744e80 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:17.149215 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b0acd05a-2a5a-4673-8006-a270d1744e80 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.498733 Jun 07 13:18:17.149768 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 319/638] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:16 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:17.804475 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-70edb1a1-d0b0-4064-8f69-e227c4afdf50 req-f46767d5-04f3-49ae-a3a7-19e9376d533f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1300519b-aeac-4d90-a5ae-c2cf6ee62554", "tag": "861926a2-c35d-4ff9-9ccf-2e5db51c909d"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:17.813707 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-70edb1a1-d0b0-4064-8f69-e227c4afdf50 req-f46767d5-04f3-49ae-a3a7-19e9376d533f service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:17.814429 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-70edb1a1-d0b0-4064-8f69-e227c4afdf50 req-f46767d5-04f3-49ae-a3a7-19e9376d533f service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:17.827002 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-70edb1a1-d0b0-4064-8f69-e227c4afdf50 req-f46767d5-04f3-49ae-a3a7-19e9376d533f service nova] Creating event network-changed:861926a2-c35d-4ff9-9ccf-2e5db51c909d for instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 on hv-cinder-84496 Jun 07 13:18:17.832444 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-70edb1a1-d0b0-4064-8f69-e227c4afdf50 req-f46767d5-04f3-49ae-a3a7-19e9376d533f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033159 Jun 07 13:18:17.833039 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 320/639] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:18:17.928791 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-aaa49713-4505-433f-9219-5e99b895b6bd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:17.929411 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-aaa49713-4505-433f-9219-5e99b895b6bd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:17.936138 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aaa49713-4505-433f-9219-5e99b895b6bd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:17.936596 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aaa49713-4505-433f-9219-5e99b895b6bd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:17.937372 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aaa49713-4505-433f-9219-5e99b895b6bd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:17.938500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aaa49713-4505-433f-9219-5e99b895b6bd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:18.071450 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-aaa49713-4505-433f-9219-5e99b895b6bd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:18.079446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0fed3623-1489-4a9d-8b8a-3eac163936f1 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:18.079631 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-aaa49713-4505-433f-9219-5e99b895b6bd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1711 microversion: 2.1 time: 0.154542 Jun 07 13:18:18.080069 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 320/640] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:17 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1711 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:18.080246 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0fed3623-1489-4a9d-8b8a-3eac163936f1 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:18.086297 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0fed3623-1489-4a9d-8b8a-3eac163936f1 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:18.086795 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0fed3623-1489-4a9d-8b8a-3eac163936f1 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:18.087552 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0fed3623-1489-4a9d-8b8a-3eac163936f1 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:18.087983 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0fed3623-1489-4a9d-8b8a-3eac163936f1 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:18.167551 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2295e30b-425d-40c8-af54-c315e8357351 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:18.168154 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2295e30b-425d-40c8-af54-c315e8357351 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:18.174844 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2295e30b-425d-40c8-af54-c315e8357351 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:18.175290 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2295e30b-425d-40c8-af54-c315e8357351 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:18.176051 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2295e30b-425d-40c8-af54-c315e8357351 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:18.176533 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2295e30b-425d-40c8-af54-c315e8357351 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:18.220949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0fed3623-1489-4a9d-8b8a-3eac163936f1 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:18.228436 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0fed3623-1489-4a9d-8b8a-3eac163936f1 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.153085 Jun 07 13:18:18.236206 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 321/641] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:18 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:18.354353 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2295e30b-425d-40c8-af54-c315e8357351 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:18.362290 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2295e30b-425d-40c8-af54-c315e8357351 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:18.363866 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2295e30b-425d-40c8-af54-c315e8357351 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:18.365008 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2295e30b-425d-40c8-af54-c315e8357351 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.201411 Jun 07 13:18:18.365570 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 321/642] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:18 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:18:19.096205 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-4286ef2b-e895-4f1f-b151-a85044a20ce2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:19.096727 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-4286ef2b-e895-4f1f-b151-a85044a20ce2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:19.102805 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4286ef2b-e895-4f1f-b151-a85044a20ce2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:19.103251 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4286ef2b-e895-4f1f-b151-a85044a20ce2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:19.104001 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4286ef2b-e895-4f1f-b151-a85044a20ce2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:19.104432 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4286ef2b-e895-4f1f-b151-a85044a20ce2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:19.227709 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-4286ef2b-e895-4f1f-b151-a85044a20ce2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:19.236096 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-4286ef2b-e895-4f1f-b151-a85044a20ce2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1715 microversion: 2.1 time: 0.143816 Jun 07 13:18:19.236655 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 322/643] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:19 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1715 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:19.246657 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-439a578d-43ed-4fb6-bd5b-009f7a45622f tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:19.247270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-439a578d-43ed-4fb6-bd5b-009f7a45622f tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:19.254424 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-439a578d-43ed-4fb6-bd5b-009f7a45622f tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:19.254910 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-439a578d-43ed-4fb6-bd5b-009f7a45622f tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:19.255677 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-439a578d-43ed-4fb6-bd5b-009f7a45622f tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:19.256116 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-439a578d-43ed-4fb6-bd5b-009f7a45622f tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:19.382652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-dfc93aa6-eef7-4766-8e5d-461c8c2e33f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:19.383146 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-dfc93aa6-eef7-4766-8e5d-461c8c2e33f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:19.389190 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dfc93aa6-eef7-4766-8e5d-461c8c2e33f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:19.389630 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dfc93aa6-eef7-4766-8e5d-461c8c2e33f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:19.390404 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dfc93aa6-eef7-4766-8e5d-461c8c2e33f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:19.391493 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dfc93aa6-eef7-4766-8e5d-461c8c2e33f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:19.415347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-439a578d-43ed-4fb6-bd5b-009f7a45622f tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:19.424775 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-439a578d-43ed-4fb6-bd5b-009f7a45622f tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.181195 Jun 07 13:18:19.425407 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 322/644] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:19 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:19.524581 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-dfc93aa6-eef7-4766-8e5d-461c8c2e33f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:19.534057 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-dfc93aa6-eef7-4766-8e5d-461c8c2e33f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:19.535588 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-dfc93aa6-eef7-4766-8e5d-461c8c2e33f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:19.536759 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-dfc93aa6-eef7-4766-8e5d-461c8c2e33f9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1743 microversion: 2.20 time: 0.158156 Jun 07 13:18:19.537320 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 323/645] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:19 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:20.441799 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-800f0fbb-3ea0-40f6-935e-f5abd54e74f7 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:20.442433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-800f0fbb-3ea0-40f6-935e-f5abd54e74f7 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:20.448903 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-800f0fbb-3ea0-40f6-935e-f5abd54e74f7 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:20.449348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-800f0fbb-3ea0-40f6-935e-f5abd54e74f7 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:20.450123 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-800f0fbb-3ea0-40f6-935e-f5abd54e74f7 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:20.450580 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-800f0fbb-3ea0-40f6-935e-f5abd54e74f7 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:20.555773 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-04802ca1-f7a5-4e9d-9796-29a2f2d97e78 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:20.556488 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-04802ca1-f7a5-4e9d-9796-29a2f2d97e78 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:20.563202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-04802ca1-f7a5-4e9d-9796-29a2f2d97e78 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:20.563656 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-04802ca1-f7a5-4e9d-9796-29a2f2d97e78 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:20.564415 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-04802ca1-f7a5-4e9d-9796-29a2f2d97e78 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:20.564848 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-04802ca1-f7a5-4e9d-9796-29a2f2d97e78 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:20.578040 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-800f0fbb-3ea0-40f6-935e-f5abd54e74f7 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:20.585898 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-800f0fbb-3ea0-40f6-935e-f5abd54e74f7 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.148399 Jun 07 13:18:20.586524 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 323/646] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:20 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:20.701514 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-04802ca1-f7a5-4e9d-9796-29a2f2d97e78 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:20.709378 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-04802ca1-f7a5-4e9d-9796-29a2f2d97e78 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:20.710975 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-04802ca1-f7a5-4e9d-9796-29a2f2d97e78 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:20.712119 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-04802ca1-f7a5-4e9d-9796-29a2f2d97e78 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1743 microversion: 2.20 time: 0.160183 Jun 07 13:18:20.712672 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 324/647] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:20 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:18:21.547724 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-3a8ce156-4f76-4a54-b177-fc048a2de64f req-53886514-59b7-4232-8c2b-b77af243ad39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64eec94b-9fac-4ad4-8386-01a27db4d5ce", "name": "network-vif-plugged", "status": "completed", "tag": "689501bc-bf08-4b3c-8c94-bc415ab172a1"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:21.557172 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-3a8ce156-4f76-4a54-b177-fc048a2de64f req-53886514-59b7-4232-8c2b-b77af243ad39 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:21.557596 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-3a8ce156-4f76-4a54-b177-fc048a2de64f req-53886514-59b7-4232-8c2b-b77af243ad39 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:21.570111 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-3a8ce156-4f76-4a54-b177-fc048a2de64f req-53886514-59b7-4232-8c2b-b77af243ad39 service nova] Creating event network-vif-plugged:689501bc-bf08-4b3c-8c94-bc415ab172a1 for instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce on hv-cinder-84496 Jun 07 13:18:21.575293 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-3a8ce156-4f76-4a54-b177-fc048a2de64f req-53886514-59b7-4232-8c2b-b77af243ad39 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031372 Jun 07 13:18:21.576063 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 324/648] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:21.602594 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1009af61-869b-46b9-b4bc-fe080bd31a76 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:21.603794 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1009af61-869b-46b9-b4bc-fe080bd31a76 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:21.609751 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1009af61-869b-46b9-b4bc-fe080bd31a76 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:21.610201 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1009af61-869b-46b9-b4bc-fe080bd31a76 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:21.611061 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1009af61-869b-46b9-b4bc-fe080bd31a76 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:21.611495 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1009af61-869b-46b9-b4bc-fe080bd31a76 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:21.615691 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:21.729677 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7c86d215-491c-4598-93b4-1e1e2d7d8236 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:21.730419 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7c86d215-491c-4598-93b4-1e1e2d7d8236 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:21.736689 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7c86d215-491c-4598-93b4-1e1e2d7d8236 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:21.737177 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7c86d215-491c-4598-93b4-1e1e2d7d8236 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:21.737944 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7c86d215-491c-4598-93b4-1e1e2d7d8236 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:21.738383 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7c86d215-491c-4598-93b4-1e1e2d7d8236 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:21.742818 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1009af61-869b-46b9-b4bc-fe080bd31a76 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:21.750661 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1009af61-869b-46b9-b4bc-fe080bd31a76 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.151569 Jun 07 13:18:21.751291 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 325/649] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:21 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:21.865419 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7c86d215-491c-4598-93b4-1e1e2d7d8236 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:21.873332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7c86d215-491c-4598-93b4-1e1e2d7d8236 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:21.874870 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7c86d215-491c-4598-93b4-1e1e2d7d8236 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:21.876544 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7c86d215-491c-4598-93b4-1e1e2d7d8236 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1743 microversion: 2.20 time: 0.151158 Jun 07 13:18:21.877105 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 325/650] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:21 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:18:22.766815 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a4924fc4-f979-443a-b1ec-7a98b70f33fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:22.767464 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a4924fc4-f979-443a-b1ec-7a98b70f33fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:22.773462 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a4924fc4-f979-443a-b1ec-7a98b70f33fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:22.773909 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a4924fc4-f979-443a-b1ec-7a98b70f33fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:22.774757 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a4924fc4-f979-443a-b1ec-7a98b70f33fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:22.775194 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a4924fc4-f979-443a-b1ec-7a98b70f33fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:22.895365 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5d8cf900-5964-4f8e-928d-91c8061aaa8d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:22.895999 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5d8cf900-5964-4f8e-928d-91c8061aaa8d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:22.902397 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5d8cf900-5964-4f8e-928d-91c8061aaa8d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:22.902879 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5d8cf900-5964-4f8e-928d-91c8061aaa8d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:22.903647 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5d8cf900-5964-4f8e-928d-91c8061aaa8d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:22.904079 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5d8cf900-5964-4f8e-928d-91c8061aaa8d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:22.904186 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a4924fc4-f979-443a-b1ec-7a98b70f33fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:22.912392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a4924fc4-f979-443a-b1ec-7a98b70f33fb tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.149554 Jun 07 13:18:22.912950 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 326/651] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:22 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:23.029074 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5d8cf900-5964-4f8e-928d-91c8061aaa8d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:23.037799 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5d8cf900-5964-4f8e-928d-91c8061aaa8d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:23.039330 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5d8cf900-5964-4f8e-928d-91c8061aaa8d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:23.040480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5d8cf900-5964-4f8e-928d-91c8061aaa8d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1743 microversion: 2.20 time: 0.149669 Jun 07 13:18:23.041037 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 326/652] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:22 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:18:23.929481 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-dfbce5e4-fc8f-433b-a13c-430dcc123461 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:23.930088 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-dfbce5e4-fc8f-433b-a13c-430dcc123461 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:23.936056 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dfbce5e4-fc8f-433b-a13c-430dcc123461 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:23.936495 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dfbce5e4-fc8f-433b-a13c-430dcc123461 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:23.937237 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dfbce5e4-fc8f-433b-a13c-430dcc123461 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:23.938257 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dfbce5e4-fc8f-433b-a13c-430dcc123461 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:24.058356 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9d7cddb1-b825-45a3-b222-6c533322edf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:24.059038 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9d7cddb1-b825-45a3-b222-6c533322edf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:24.061427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-dfbce5e4-fc8f-433b-a13c-430dcc123461 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:24.065484 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9d7cddb1-b825-45a3-b222-6c533322edf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:24.065938 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9d7cddb1-b825-45a3-b222-6c533322edf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:24.066738 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9d7cddb1-b825-45a3-b222-6c533322edf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:24.067178 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9d7cddb1-b825-45a3-b222-6c533322edf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:24.068842 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-dfbce5e4-fc8f-433b-a13c-430dcc123461 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.143156 Jun 07 13:18:24.069548 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 327/653] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:23 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:24.196551 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9d7cddb1-b825-45a3-b222-6c533322edf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:24.198941 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:24.205713 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9d7cddb1-b825-45a3-b222-6c533322edf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:24.207244 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9d7cddb1-b825-45a3-b222-6c533322edf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:24.208388 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9d7cddb1-b825-45a3-b222-6c533322edf0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1743 microversion: 2.20 time: 0.153902 Jun 07 13:18:24.208941 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 327/654] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:24 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:18:25.085486 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1781a774-66cc-471b-b695-afe15338570d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:25.086092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1781a774-66cc-471b-b695-afe15338570d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:25.092053 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1781a774-66cc-471b-b695-afe15338570d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:25.092492 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1781a774-66cc-471b-b695-afe15338570d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:25.093238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1781a774-66cc-471b-b695-afe15338570d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:25.093667 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1781a774-66cc-471b-b695-afe15338570d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:25.226930 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1781a774-66cc-471b-b695-afe15338570d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:25.228026 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ab55f27d-d636-406c-b213-f6366af9d26f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:25.228781 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ab55f27d-d636-406c-b213-f6366af9d26f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:25.235118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1781a774-66cc-471b-b695-afe15338570d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.152888 Jun 07 13:18:25.235697 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 328/655] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:25 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:25.235833 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ab55f27d-d636-406c-b213-f6366af9d26f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:25.236256 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ab55f27d-d636-406c-b213-f6366af9d26f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:25.237025 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ab55f27d-d636-406c-b213-f6366af9d26f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:25.237451 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ab55f27d-d636-406c-b213-f6366af9d26f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:25.363833 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ab55f27d-d636-406c-b213-f6366af9d26f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:25.371735 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ab55f27d-d636-406c-b213-f6366af9d26f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:25.373249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ab55f27d-d636-406c-b213-f6366af9d26f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:25.374406 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ab55f27d-d636-406c-b213-f6366af9d26f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1743 microversion: 2.20 time: 0.151060 Jun 07 13:18:25.377327 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 328/656] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:25 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:18:26.023781 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-e0af378e-8e88-4993-87db-09b9610e65f9 req-4b9d05fb-feff-4c89-b896-fda46474436a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1300519b-aeac-4d90-a5ae-c2cf6ee62554", "name": "network-vif-plugged", "status": "completed", "tag": "861926a2-c35d-4ff9-9ccf-2e5db51c909d"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:26.032689 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-e0af378e-8e88-4993-87db-09b9610e65f9 req-4b9d05fb-feff-4c89-b896-fda46474436a service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:26.033147 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-e0af378e-8e88-4993-87db-09b9610e65f9 req-4b9d05fb-feff-4c89-b896-fda46474436a service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:26.044560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-e0af378e-8e88-4993-87db-09b9610e65f9 req-4b9d05fb-feff-4c89-b896-fda46474436a service nova] Creating event network-vif-plugged:861926a2-c35d-4ff9-9ccf-2e5db51c909d for instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 on hv-cinder-84496 Jun 07 13:18:26.049397 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-e0af378e-8e88-4993-87db-09b9610e65f9 req-4b9d05fb-feff-4c89-b896-fda46474436a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029375 Jun 07 13:18:26.049987 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 329/657] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:26.252501 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-02c31621-5d06-4d1e-bc82-9893b7d2852d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:26.253178 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-02c31621-5d06-4d1e-bc82-9893b7d2852d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:26.261801 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-02c31621-5d06-4d1e-bc82-9893b7d2852d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:26.262652 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-02c31621-5d06-4d1e-bc82-9893b7d2852d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:26.263518 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-02c31621-5d06-4d1e-bc82-9893b7d2852d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:26.263964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-02c31621-5d06-4d1e-bc82-9893b7d2852d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:26.395363 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-bfa4f8ba-727b-47c4-b7b7-e09c75276b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:26.396268 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-bfa4f8ba-727b-47c4-b7b7-e09c75276b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:26.402707 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bfa4f8ba-727b-47c4-b7b7-e09c75276b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:26.403159 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bfa4f8ba-727b-47c4-b7b7-e09c75276b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:26.403921 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bfa4f8ba-727b-47c4-b7b7-e09c75276b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:26.404357 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bfa4f8ba-727b-47c4-b7b7-e09c75276b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:26.422768 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-02c31621-5d06-4d1e-bc82-9893b7d2852d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:26.430229 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-02c31621-5d06-4d1e-bc82-9893b7d2852d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.182047 Jun 07 13:18:26.430867 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 329/658] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:26 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:26.530166 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-bfa4f8ba-727b-47c4-b7b7-e09c75276b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:26.538292 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-bfa4f8ba-727b-47c4-b7b7-e09c75276b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:26.539810 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-bfa4f8ba-727b-47c4-b7b7-e09c75276b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:26.540941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-bfa4f8ba-727b-47c4-b7b7-e09c75276b08 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1743 microversion: 2.20 time: 0.150620 Jun 07 13:18:26.541484 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 330/659] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:26 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:18:27.446816 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4c2a8847-7f9b-4109-9651-51d849453a37 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:27.447435 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4c2a8847-7f9b-4109-9651-51d849453a37 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:27.449713 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:27.455588 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c2a8847-7f9b-4109-9651-51d849453a37 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:27.456046 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c2a8847-7f9b-4109-9651-51d849453a37 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:27.456807 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c2a8847-7f9b-4109-9651-51d849453a37 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:27.457246 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c2a8847-7f9b-4109-9651-51d849453a37 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:27.558973 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-169ca525-8912-43a9-93f8-4dcad08d30d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:27.559591 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-169ca525-8912-43a9-93f8-4dcad08d30d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:27.565471 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-169ca525-8912-43a9-93f8-4dcad08d30d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:27.565919 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-169ca525-8912-43a9-93f8-4dcad08d30d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:27.566704 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-169ca525-8912-43a9-93f8-4dcad08d30d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:27.567157 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-169ca525-8912-43a9-93f8-4dcad08d30d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:27.585377 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4c2a8847-7f9b-4109-9651-51d849453a37 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:27.592826 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4c2a8847-7f9b-4109-9651-51d849453a37 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1358 microversion: 2.1 time: 0.149968 Jun 07 13:18:27.593515 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 330/660] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:27 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:27.691657 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-169ca525-8912-43a9-93f8-4dcad08d30d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:27.699644 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-169ca525-8912-43a9-93f8-4dcad08d30d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:27.701182 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-169ca525-8912-43a9-93f8-4dcad08d30d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:27.702329 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-169ca525-8912-43a9-93f8-4dcad08d30d9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1738 microversion: 2.20 time: 0.147194 Jun 07 13:18:27.702910 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 331/661] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:27 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:28.610227 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ac0d716a-7aef-4697-bd35-7b25e499158d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:28.611665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ac0d716a-7aef-4697-bd35-7b25e499158d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:28.621770 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ac0d716a-7aef-4697-bd35-7b25e499158d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:28.622691 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ac0d716a-7aef-4697-bd35-7b25e499158d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:28.623560 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ac0d716a-7aef-4697-bd35-7b25e499158d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:28.624194 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ac0d716a-7aef-4697-bd35-7b25e499158d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:28.724691 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-088945f4-20e7-4e6f-919c-961a34900d06 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:28.726553 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-088945f4-20e7-4e6f-919c-961a34900d06 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:28.734203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-088945f4-20e7-4e6f-919c-961a34900d06 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:28.734962 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-088945f4-20e7-4e6f-919c-961a34900d06 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:28.735730 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-088945f4-20e7-4e6f-919c-961a34900d06 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:28.736159 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-088945f4-20e7-4e6f-919c-961a34900d06 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:28.786986 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ac0d716a-7aef-4697-bd35-7b25e499158d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:28.797023 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ac0d716a-7aef-4697-bd35-7b25e499158d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1548 microversion: 2.1 time: 0.190422 Jun 07 13:18:28.810382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 331/662] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:28 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1548 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:28.817257 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6c73a5ab-4da2-402d-afc4-2e04119bc355 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:28.817257 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6c73a5ab-4da2-402d-afc4-2e04119bc355 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:28.826367 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c73a5ab-4da2-402d-afc4-2e04119bc355 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:28.827694 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c73a5ab-4da2-402d-afc4-2e04119bc355 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:28.846981 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c73a5ab-4da2-402d-afc4-2e04119bc355 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:28.849523 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c73a5ab-4da2-402d-afc4-2e04119bc355 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:28.895547 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-088945f4-20e7-4e6f-919c-961a34900d06 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:28.904204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-088945f4-20e7-4e6f-919c-961a34900d06 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:28.905702 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-088945f4-20e7-4e6f-919c-961a34900d06 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:28.907549 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-088945f4-20e7-4e6f-919c-961a34900d06 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1738 microversion: 2.20 time: 0.189706 Jun 07 13:18:28.910652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 332/663] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:28 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:29.008863 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6c73a5ab-4da2-402d-afc4-2e04119bc355 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:29.017338 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6c73a5ab-4da2-402d-afc4-2e04119bc355 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1548 microversion: 2.1 time: 0.205443 Jun 07 13:18:29.028062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 332/664] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:28 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1548 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:29.035966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-651449fd-5b2e-4bb4-91c3-1986947f9135 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:29.039593 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-651449fd-5b2e-4bb4-91c3-1986947f9135 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:29.040360 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-651449fd-5b2e-4bb4-91c3-1986947f9135 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Searching by: {'deleted': False, 'project_id': 'fd9536c09221459485abe72ab8e43d99'} {{(pid=117797) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 07 13:18:29.049474 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-651449fd-5b2e-4bb4-91c3-1986947f9135 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:29.049911 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-651449fd-5b2e-4bb4-91c3-1986947f9135 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:29.050722 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-651449fd-5b2e-4bb4-91c3-1986947f9135 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:29.051349 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-651449fd-5b2e-4bb4-91c3-1986947f9135 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:29.159354 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.multi_cell_list [None req-651449fd-5b2e-4bb4-91c3-1986947f9135 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117797) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 07 13:18:29.279605 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-651449fd-5b2e-4bb4-91c3-1986947f9135 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.248039 Jun 07 13:18:29.280449 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 333/665] 10.222.0.58 () {58 vars in 1124 bytes} [Tue Jun 7 13:18:29 2022] GET /compute/v2.1/servers => generated 343 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:29.290857 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-771c3ca1-e444-4269-b579-653775fe33dc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:29.291379 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-771c3ca1-e444-4269-b579-653775fe33dc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:29.297946 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-771c3ca1-e444-4269-b579-653775fe33dc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:29.298398 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-771c3ca1-e444-4269-b579-653775fe33dc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:29.299229 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-771c3ca1-e444-4269-b579-653775fe33dc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:29.299661 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-771c3ca1-e444-4269-b579-653775fe33dc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:29.449391 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-771c3ca1-e444-4269-b579-653775fe33dc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:29.457682 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-771c3ca1-e444-4269-b579-653775fe33dc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1548 microversion: 2.1 time: 0.170699 Jun 07 13:18:29.464089 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 333/666] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:29 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:29.926880 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-664fb728-8ef3-4594-a367-7f7711abd834 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:29.927482 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-664fb728-8ef3-4594-a367-7f7711abd834 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:29.933769 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-664fb728-8ef3-4594-a367-7f7711abd834 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:29.934634 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-664fb728-8ef3-4594-a367-7f7711abd834 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:29.935518 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-664fb728-8ef3-4594-a367-7f7711abd834 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:29.935985 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-664fb728-8ef3-4594-a367-7f7711abd834 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:30.087113 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-664fb728-8ef3-4594-a367-7f7711abd834 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:30.096781 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-664fb728-8ef3-4594-a367-7f7711abd834 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:30.098302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-664fb728-8ef3-4594-a367-7f7711abd834 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:30.099497 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-664fb728-8ef3-4594-a367-7f7711abd834 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1738 microversion: 2.20 time: 0.178362 Jun 07 13:18:30.100055 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 334/667] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:29 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:31.119112 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d738a1da-8ba2-48f6-90cb-233bc7daa189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:31.119827 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d738a1da-8ba2-48f6-90cb-233bc7daa189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:31.136481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d738a1da-8ba2-48f6-90cb-233bc7daa189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:31.136872 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d738a1da-8ba2-48f6-90cb-233bc7daa189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:31.138008 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d738a1da-8ba2-48f6-90cb-233bc7daa189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:31.138955 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d738a1da-8ba2-48f6-90cb-233bc7daa189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:31.139493 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d64c2103-6535-47c1-9c15-cabcf1c8e4c6 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c39831d5-c4ed-4015-bfc8-a805ee8d0d54"}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:31.141605 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d64c2103-6535-47c1-9c15-cabcf1c8e4c6 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:31.148170 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d64c2103-6535-47c1-9c15-cabcf1c8e4c6 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:31.148842 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d64c2103-6535-47c1-9c15-cabcf1c8e4c6 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:31.149771 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d64c2103-6535-47c1-9c15-cabcf1c8e4c6 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:31.150354 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d64c2103-6535-47c1-9c15-cabcf1c8e4c6 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:31.380625 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d738a1da-8ba2-48f6-90cb-233bc7daa189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:31.389426 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d738a1da-8ba2-48f6-90cb-233bc7daa189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:31.392814 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d738a1da-8ba2-48f6-90cb-233bc7daa189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:31.394209 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d738a1da-8ba2-48f6-90cb-233bc7daa189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1738 microversion: 2.20 time: 0.279432 Jun 07 13:18:31.405050 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 334/668] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:31 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:31.533592 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d64c2103-6535-47c1-9c15-cabcf1c8e4c6 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "POST /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.397696 Jun 07 13:18:31.534319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 335/669] 10.222.0.58 () {60 vars in 1322 bytes} [Tue Jun 7 13:18:31 2022] POST /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:32.414244 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-78da2df1-c065-407a-80bd-1444b4111982 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:32.415708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-78da2df1-c065-407a-80bd-1444b4111982 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:32.423049 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-78da2df1-c065-407a-80bd-1444b4111982 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:32.423704 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-78da2df1-c065-407a-80bd-1444b4111982 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:32.424677 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-78da2df1-c065-407a-80bd-1444b4111982 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:32.425365 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-78da2df1-c065-407a-80bd-1444b4111982 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:32.571193 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-78da2df1-c065-407a-80bd-1444b4111982 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:32.580948 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-78da2df1-c065-407a-80bd-1444b4111982 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:32.582895 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-78da2df1-c065-407a-80bd-1444b4111982 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:32.584143 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-78da2df1-c065-407a-80bd-1444b4111982 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1738 microversion: 2.20 time: 0.174496 Jun 07 13:18:32.584776 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 335/670] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:32 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:33.604137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d8699b4b-3c37-480c-b283-8c9c1af87a2f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:33.604828 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d8699b4b-3c37-480c-b283-8c9c1af87a2f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:33.610996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=70 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:33.613483 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d8699b4b-3c37-480c-b283-8c9c1af87a2f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:33.614001 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d8699b4b-3c37-480c-b283-8c9c1af87a2f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:33.614943 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d8699b4b-3c37-480c-b283-8c9c1af87a2f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:33.615385 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d8699b4b-3c37-480c-b283-8c9c1af87a2f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:33.767003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d8699b4b-3c37-480c-b283-8c9c1af87a2f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:33.777632 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d8699b4b-3c37-480c-b283-8c9c1af87a2f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:33.779243 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d8699b4b-3c37-480c-b283-8c9c1af87a2f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:33.780369 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d8699b4b-3c37-480c-b283-8c9c1af87a2f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1738 microversion: 2.20 time: 0.181317 Jun 07 13:18:33.780926 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 336/671] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:33 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:34.799687 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7a342efc-80cb-4015-91e0-26da100904dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:34.800884 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7a342efc-80cb-4015-91e0-26da100904dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:34.807339 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7a342efc-80cb-4015-91e0-26da100904dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:34.807995 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7a342efc-80cb-4015-91e0-26da100904dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:34.808967 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7a342efc-80cb-4015-91e0-26da100904dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:34.809726 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7a342efc-80cb-4015-91e0-26da100904dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:34.963911 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7a342efc-80cb-4015-91e0-26da100904dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:34.973473 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7a342efc-80cb-4015-91e0-26da100904dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:34.975014 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7a342efc-80cb-4015-91e0-26da100904dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:34.976169 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7a342efc-80cb-4015-91e0-26da100904dd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1738 microversion: 2.20 time: 0.181001 Jun 07 13:18:34.976909 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 336/672] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:34 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:35.994490 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-affe4846-71ca-42a3-871c-ac2362297122 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:35.995218 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-affe4846-71ca-42a3-871c-ac2362297122 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:36.003444 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-affe4846-71ca-42a3-871c-ac2362297122 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:36.003911 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-affe4846-71ca-42a3-871c-ac2362297122 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:36.004810 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-affe4846-71ca-42a3-871c-ac2362297122 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:36.005251 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-affe4846-71ca-42a3-871c-ac2362297122 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:36.163273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-affe4846-71ca-42a3-871c-ac2362297122 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:36.172481 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-affe4846-71ca-42a3-871c-ac2362297122 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:36.174355 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-affe4846-71ca-42a3-871c-ac2362297122 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:36.175577 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-affe4846-71ca-42a3-871c-ac2362297122 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1738 microversion: 2.20 time: 0.185190 Jun 07 13:18:36.176300 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 337/673] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:35 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:37.192963 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c1a96488-8baa-44e7-ae02-8355c6713cd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:37.193575 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c1a96488-8baa-44e7-ae02-8355c6713cd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:37.199999 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c1a96488-8baa-44e7-ae02-8355c6713cd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:37.200445 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c1a96488-8baa-44e7-ae02-8355c6713cd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:37.201201 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c1a96488-8baa-44e7-ae02-8355c6713cd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:37.201633 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c1a96488-8baa-44e7-ae02-8355c6713cd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:37.325042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c1a96488-8baa-44e7-ae02-8355c6713cd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:37.333344 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c1a96488-8baa-44e7-ae02-8355c6713cd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:37.334901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c1a96488-8baa-44e7-ae02-8355c6713cd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:37.336047 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c1a96488-8baa-44e7-ae02-8355c6713cd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1738 microversion: 2.20 time: 0.146961 Jun 07 13:18:37.336608 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 337/674] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:37 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:38.354615 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9ac49463-c6ba-4d84-b51e-e371fb9a9edd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:38.355214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9ac49463-c6ba-4d84-b51e-e371fb9a9edd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:38.362282 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9ac49463-c6ba-4d84-b51e-e371fb9a9edd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:38.362861 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9ac49463-c6ba-4d84-b51e-e371fb9a9edd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:38.363616 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9ac49463-c6ba-4d84-b51e-e371fb9a9edd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:38.364045 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9ac49463-c6ba-4d84-b51e-e371fb9a9edd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:38.487435 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9ac49463-c6ba-4d84-b51e-e371fb9a9edd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:38.495409 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9ac49463-c6ba-4d84-b51e-e371fb9a9edd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:38.496911 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9ac49463-c6ba-4d84-b51e-e371fb9a9edd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:38.498048 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9ac49463-c6ba-4d84-b51e-e371fb9a9edd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1720 microversion: 2.20 time: 0.147329 Jun 07 13:18:38.498643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 338/675] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:38 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:39.516449 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d11ede09-59ae-4661-b027-54b719cae250 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:39.516972 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d11ede09-59ae-4661-b027-54b719cae250 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:39.523387 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d11ede09-59ae-4661-b027-54b719cae250 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:39.523826 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d11ede09-59ae-4661-b027-54b719cae250 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:39.524569 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d11ede09-59ae-4661-b027-54b719cae250 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:39.524996 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d11ede09-59ae-4661-b027-54b719cae250 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:39.652918 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d11ede09-59ae-4661-b027-54b719cae250 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:39.661459 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d11ede09-59ae-4661-b027-54b719cae250 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:39.663016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d11ede09-59ae-4661-b027-54b719cae250 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:39.664172 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d11ede09-59ae-4661-b027-54b719cae250 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1720 microversion: 2.20 time: 0.151644 Jun 07 13:18:39.664724 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 338/676] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:39 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:40.165824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7d81bc4f-4ae5-4c87-b6fd-1f34f0d1301f tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:40.166489 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7d81bc4f-4ae5-4c87-b6fd-1f34f0d1301f tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:40.168345 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=2 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:40.174178 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7d81bc4f-4ae5-4c87-b6fd-1f34f0d1301f tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:40.174656 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7d81bc4f-4ae5-4c87-b6fd-1f34f0d1301f tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:40.175414 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7d81bc4f-4ae5-4c87-b6fd-1f34f0d1301f tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:40.175848 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7d81bc4f-4ae5-4c87-b6fd-1f34f0d1301f tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:40.303698 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-7d81bc4f-4ae5-4c87-b6fd-1f34f0d1301f tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:40.312489 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-7d81bc4f-4ae5-4c87-b6fd-1f34f0d1301f tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1594 microversion: 2.1 time: 0.150299 Jun 07 13:18:40.312987 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 339/677] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:40 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1594 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:40.682542 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0da29bdb-1bfa-4738-91fc-0a54eb9f3fc0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:40.683705 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0da29bdb-1bfa-4738-91fc-0a54eb9f3fc0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:40.690550 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0da29bdb-1bfa-4738-91fc-0a54eb9f3fc0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:40.690994 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0da29bdb-1bfa-4738-91fc-0a54eb9f3fc0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:40.691936 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0da29bdb-1bfa-4738-91fc-0a54eb9f3fc0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:40.692370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0da29bdb-1bfa-4738-91fc-0a54eb9f3fc0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:40.874954 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0da29bdb-1bfa-4738-91fc-0a54eb9f3fc0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:40.883815 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0da29bdb-1bfa-4738-91fc-0a54eb9f3fc0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:40.885304 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0da29bdb-1bfa-4738-91fc-0a54eb9f3fc0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:40.886458 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0da29bdb-1bfa-4738-91fc-0a54eb9f3fc0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1720 microversion: 2.20 time: 0.207806 Jun 07 13:18:40.887014 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 339/678] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:40 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:41.904471 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-bc56f45a-392d-4c15-acc7-2a4400a79411 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:41.905807 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-bc56f45a-392d-4c15-acc7-2a4400a79411 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:41.913630 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bc56f45a-392d-4c15-acc7-2a4400a79411 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:41.914203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bc56f45a-392d-4c15-acc7-2a4400a79411 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:41.915104 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bc56f45a-392d-4c15-acc7-2a4400a79411 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:41.915756 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bc56f45a-392d-4c15-acc7-2a4400a79411 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:42.063834 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-bc56f45a-392d-4c15-acc7-2a4400a79411 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:42.067532 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:42.074453 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-bc56f45a-392d-4c15-acc7-2a4400a79411 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:42.075345 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-58ecabe9-450c-44bd-9e6a-12cdfaf5c090 req-ffa8dc82-ba5e-4a77-8ae2-3e44489eef30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64eec94b-9fac-4ad4-8386-01a27db4d5ce", "name": "network-vif-unplugged", "status": "completed", "tag": "689501bc-bf08-4b3c-8c94-bc415ab172a1"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:42.076866 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-bc56f45a-392d-4c15-acc7-2a4400a79411 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:42.079218 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-bc56f45a-392d-4c15-acc7-2a4400a79411 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1663 microversion: 2.20 time: 0.177850 Jun 07 13:18:42.080280 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 340/679] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:41 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1663 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:42.088052 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-58ecabe9-450c-44bd-9e6a-12cdfaf5c090 req-ffa8dc82-ba5e-4a77-8ae2-3e44489eef30 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.088586 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-58ecabe9-450c-44bd-9e6a-12cdfaf5c090 req-ffa8dc82-ba5e-4a77-8ae2-3e44489eef30 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:42.097718 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-24c8c4b0-22a0-4316-ba5b-37d44181a177 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbae8004-ce6f-4e92-9ff5-9bbea8a3c8a8"}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:42.098857 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-24c8c4b0-22a0-4316-ba5b-37d44181a177 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:42.103361 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.compute.server_external_events [req-58ecabe9-450c-44bd-9e6a-12cdfaf5c090 req-ffa8dc82-ba5e-4a77-8ae2-3e44489eef30 service nova] Unable to find a host for instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce. Dropping event network-vif-unplugged {{(pid=117798) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 13:18:42.104260 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-58ecabe9-450c-44bd-9e6a-12cdfaf5c090 req-ffa8dc82-ba5e-4a77-8ae2-3e44489eef30 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034754 Jun 07 13:18:42.105310 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 340/680] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 07 13:18:42.106704 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-24c8c4b0-22a0-4316-ba5b-37d44181a177 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.107157 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-24c8c4b0-22a0-4316-ba5b-37d44181a177 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:42.107929 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-24c8c4b0-22a0-4316-ba5b-37d44181a177 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.108361 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-24c8c4b0-22a0-4316-ba5b-37d44181a177 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:42.335036 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-7fce8844-f4b5-4083-9db6-711f60fea7f5 req-bc622508-4cb0-4b0b-a69b-f776bf0bd010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1300519b-aeac-4d90-a5ae-c2cf6ee62554", "tag": "861926a2-c35d-4ff9-9ccf-2e5db51c909d"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:42.345288 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-7fce8844-f4b5-4083-9db6-711f60fea7f5 req-bc622508-4cb0-4b0b-a69b-f776bf0bd010 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.345658 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-7fce8844-f4b5-4083-9db6-711f60fea7f5 req-bc622508-4cb0-4b0b-a69b-f776bf0bd010 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:42.357311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-7fce8844-f4b5-4083-9db6-711f60fea7f5 req-bc622508-4cb0-4b0b-a69b-f776bf0bd010 service nova] Creating event network-changed:861926a2-c35d-4ff9-9ccf-2e5db51c909d for instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 on hv-cinder-84496 Jun 07 13:18:42.365246 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-7fce8844-f4b5-4083-9db6-711f60fea7f5 req-bc622508-4cb0-4b0b-a69b-f776bf0bd010 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035586 Jun 07 13:18:42.366265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 341/681] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:42.431173 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-24c8c4b0-22a0-4316-ba5b-37d44181a177 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "POST /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.337272 Jun 07 13:18:42.436439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 341/682] 10.222.0.58 () {62 vars in 1363 bytes} [Tue Jun 7 13:18:42 2022] POST /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/os-volume_attachments => generated 188 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:18:42.578788 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-568b7a3f-24d7-4d07-bcba-8e616a02d461 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:42.579537 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-568b7a3f-24d7-4d07-bcba-8e616a02d461 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:42.590490 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-568b7a3f-24d7-4d07-bcba-8e616a02d461 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.592609 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-568b7a3f-24d7-4d07-bcba-8e616a02d461 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:42.593482 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-568b7a3f-24d7-4d07-bcba-8e616a02d461 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.595976 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-568b7a3f-24d7-4d07-bcba-8e616a02d461 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:42.730074 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-568b7a3f-24d7-4d07-bcba-8e616a02d461 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "POST /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/action" status: 202 len: 0 microversion: 2.20 time: 0.154612 Jun 07 13:18:42.732044 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 342/683] 10.222.0.58 () {62 vars in 1318 bytes} [Tue Jun 7 13:18:42 2022] POST /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:18:42.749349 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-941f24bf-4116-4f28-aa68-0a1f5cfaf553 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:42.750058 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-941f24bf-4116-4f28-aa68-0a1f5cfaf553 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:42.760456 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-941f24bf-4116-4f28-aa68-0a1f5cfaf553 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.761109 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-941f24bf-4116-4f28-aa68-0a1f5cfaf553 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:42.762133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-941f24bf-4116-4f28-aa68-0a1f5cfaf553 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.762608 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-941f24bf-4116-4f28-aa68-0a1f5cfaf553 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:43.147152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-941f24bf-4116-4f28-aa68-0a1f5cfaf553 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:43.159732 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-941f24bf-4116-4f28-aa68-0a1f5cfaf553 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:43.161585 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-941f24bf-4116-4f28-aa68-0a1f5cfaf553 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:43.162855 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-941f24bf-4116-4f28-aa68-0a1f5cfaf553 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1749 microversion: 2.20 time: 0.426577 Jun 07 13:18:43.171096 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 342/684] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:42 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1749 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:43.678667 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1d6dbce8-7f13-4720-94d3-742929af05fc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1163704819"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:43.679409 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1d6dbce8-7f13-4720-94d3-742929af05fc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:43.685910 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1d6dbce8-7f13-4720-94d3-742929af05fc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:43.686477 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1d6dbce8-7f13-4720-94d3-742929af05fc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:43.687337 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1d6dbce8-7f13-4720-94d3-742929af05fc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:43.688372 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1d6dbce8-7f13-4720-94d3-742929af05fc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:43.876400 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.network.security_group_api [None req-1d6dbce8-7f13-4720-94d3-742929af05fc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Adding security group 17c14561-ba24-4cfc-87cf-f381f8bb93bc to port 861926a2-c35d-4ff9-9ccf-2e5db51c909d Jun 07 13:18:44.181739 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e48af627-2e46-4e57-973f-2044ce47530a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:44.182899 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-e48af627-2e46-4e57-973f-2044ce47530a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:44.190003 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e48af627-2e46-4e57-973f-2044ce47530a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:44.190673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e48af627-2e46-4e57-973f-2044ce47530a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:44.191435 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e48af627-2e46-4e57-973f-2044ce47530a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:44.191865 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e48af627-2e46-4e57-973f-2044ce47530a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:44.279639 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1d6dbce8-7f13-4720-94d3-742929af05fc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "POST /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/action" status: 202 len: 0 microversion: 2.1 time: 0.614577 Jun 07 13:18:44.281088 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 343/685] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jun 7 13:18:43 2022] POST /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/action => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:18:44.289089 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7ab7242d-38cd-45e6-a57e-8ad6488fed86 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:44.289717 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7ab7242d-38cd-45e6-a57e-8ad6488fed86 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:44.299442 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7ab7242d-38cd-45e6-a57e-8ad6488fed86 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:44.299901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7ab7242d-38cd-45e6-a57e-8ad6488fed86 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:44.301570 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7ab7242d-38cd-45e6-a57e-8ad6488fed86 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:44.302182 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7ab7242d-38cd-45e6-a57e-8ad6488fed86 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:44.346101 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e48af627-2e46-4e57-973f-2044ce47530a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:44.356330 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e48af627-2e46-4e57-973f-2044ce47530a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:44.358224 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e48af627-2e46-4e57-973f-2044ce47530a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:44.360992 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e48af627-2e46-4e57-973f-2044ce47530a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1751 microversion: 2.20 time: 0.182736 Jun 07 13:18:44.362518 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 343/686] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:44 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:18:44.385403 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-97cb1493-ef97-49af-9629-ba99288a33c5 req-f9504e98-aad7-4145-815a-8f03228ab85b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1300519b-aeac-4d90-a5ae-c2cf6ee62554", "tag": "861926a2-c35d-4ff9-9ccf-2e5db51c909d"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:44.395550 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-97cb1493-ef97-49af-9629-ba99288a33c5 req-f9504e98-aad7-4145-815a-8f03228ab85b service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:44.396167 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-97cb1493-ef97-49af-9629-ba99288a33c5 req-f9504e98-aad7-4145-815a-8f03228ab85b service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:44.411679 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-97cb1493-ef97-49af-9629-ba99288a33c5 req-f9504e98-aad7-4145-815a-8f03228ab85b service nova] Creating event network-changed:861926a2-c35d-4ff9-9ccf-2e5db51c909d for instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 on hv-cinder-84496 Jun 07 13:18:44.417773 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-97cb1493-ef97-49af-9629-ba99288a33c5 req-f9504e98-aad7-4145-815a-8f03228ab85b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035870 Jun 07 13:18:44.418809 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 344/687] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:44.510414 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7ab7242d-38cd-45e6-a57e-8ad6488fed86 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:44.518790 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7ab7242d-38cd-45e6-a57e-8ad6488fed86 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1759 microversion: 2.1 time: 0.233439 Jun 07 13:18:44.519515 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 344/688] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:44 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1759 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:45.380826 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e483bcfe-0e81-4f9a-bfd7-7d122e99ef54 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:45.381516 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-e483bcfe-0e81-4f9a-bfd7-7d122e99ef54 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:45.387806 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e483bcfe-0e81-4f9a-bfd7-7d122e99ef54 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:45.388259 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e483bcfe-0e81-4f9a-bfd7-7d122e99ef54 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:45.389082 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e483bcfe-0e81-4f9a-bfd7-7d122e99ef54 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:45.389525 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e483bcfe-0e81-4f9a-bfd7-7d122e99ef54 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:45.523300 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e483bcfe-0e81-4f9a-bfd7-7d122e99ef54 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:45.532336 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e483bcfe-0e81-4f9a-bfd7-7d122e99ef54 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:45.533851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e483bcfe-0e81-4f9a-bfd7-7d122e99ef54 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:45.535059 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e483bcfe-0e81-4f9a-bfd7-7d122e99ef54 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1751 microversion: 2.20 time: 0.158976 Jun 07 13:18:45.535623 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 345/689] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:45 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:46.552783 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fc309eb3-caaf-4378-9bc2-ccf3655e9b15 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:46.553406 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fc309eb3-caaf-4378-9bc2-ccf3655e9b15 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:46.559812 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fc309eb3-caaf-4378-9bc2-ccf3655e9b15 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:46.560263 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fc309eb3-caaf-4378-9bc2-ccf3655e9b15 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:46.561032 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fc309eb3-caaf-4378-9bc2-ccf3655e9b15 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:46.561472 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fc309eb3-caaf-4378-9bc2-ccf3655e9b15 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:46.565600 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:46.766989 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fc309eb3-caaf-4378-9bc2-ccf3655e9b15 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:46.775730 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fc309eb3-caaf-4378-9bc2-ccf3655e9b15 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:46.777248 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fc309eb3-caaf-4378-9bc2-ccf3655e9b15 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:46.778402 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fc309eb3-caaf-4378-9bc2-ccf3655e9b15 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.229591 Jun 07 13:18:46.779008 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 345/690] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:46 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:47.797622 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a3987877-a4bb-44fa-99e2-8ef7ff53d51d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:47.798274 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a3987877-a4bb-44fa-99e2-8ef7ff53d51d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:47.805086 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a3987877-a4bb-44fa-99e2-8ef7ff53d51d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:47.805535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a3987877-a4bb-44fa-99e2-8ef7ff53d51d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:47.806310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a3987877-a4bb-44fa-99e2-8ef7ff53d51d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:47.806802 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a3987877-a4bb-44fa-99e2-8ef7ff53d51d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:47.938764 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a3987877-a4bb-44fa-99e2-8ef7ff53d51d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:47.947252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a3987877-a4bb-44fa-99e2-8ef7ff53d51d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:47.948734 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a3987877-a4bb-44fa-99e2-8ef7ff53d51d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:47.949868 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a3987877-a4bb-44fa-99e2-8ef7ff53d51d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.156683 Jun 07 13:18:47.950417 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 346/691] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:47 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:48.967959 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a7aac4c0-37e7-46eb-a30d-e54378e37290 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:48.968579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a7aac4c0-37e7-46eb-a30d-e54378e37290 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:48.975085 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7aac4c0-37e7-46eb-a30d-e54378e37290 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:48.975545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7aac4c0-37e7-46eb-a30d-e54378e37290 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:48.976311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7aac4c0-37e7-46eb-a30d-e54378e37290 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:48.976751 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7aac4c0-37e7-46eb-a30d-e54378e37290 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:49.109957 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a7aac4c0-37e7-46eb-a30d-e54378e37290 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:49.120035 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a7aac4c0-37e7-46eb-a30d-e54378e37290 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:49.121579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a7aac4c0-37e7-46eb-a30d-e54378e37290 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:49.122783 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a7aac4c0-37e7-46eb-a30d-e54378e37290 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.158676 Jun 07 13:18:49.123346 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 346/692] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:48 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:50.141785 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-269a4937-58e7-48e2-81e3-3ce18bc45d0d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:50.142334 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-269a4937-58e7-48e2-81e3-3ce18bc45d0d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:50.148807 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-269a4937-58e7-48e2-81e3-3ce18bc45d0d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:50.149230 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-269a4937-58e7-48e2-81e3-3ce18bc45d0d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:50.149999 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-269a4937-58e7-48e2-81e3-3ce18bc45d0d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:50.150431 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-269a4937-58e7-48e2-81e3-3ce18bc45d0d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:50.293062 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-269a4937-58e7-48e2-81e3-3ce18bc45d0d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:50.301700 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-269a4937-58e7-48e2-81e3-3ce18bc45d0d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:50.303343 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-269a4937-58e7-48e2-81e3-3ce18bc45d0d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:50.304486 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-269a4937-58e7-48e2-81e3-3ce18bc45d0d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.167138 Jun 07 13:18:50.305045 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 347/693] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:50 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:51.329208 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ed1a123a-ba29-4313-bea3-c2e69780d3d2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:51.329915 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ed1a123a-ba29-4313-bea3-c2e69780d3d2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:51.336453 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed1a123a-ba29-4313-bea3-c2e69780d3d2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:51.336894 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed1a123a-ba29-4313-bea3-c2e69780d3d2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:51.337647 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed1a123a-ba29-4313-bea3-c2e69780d3d2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:51.338077 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed1a123a-ba29-4313-bea3-c2e69780d3d2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:51.484830 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ed1a123a-ba29-4313-bea3-c2e69780d3d2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:51.493256 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ed1a123a-ba29-4313-bea3-c2e69780d3d2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:51.494789 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ed1a123a-ba29-4313-bea3-c2e69780d3d2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:51.495943 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ed1a123a-ba29-4313-bea3-c2e69780d3d2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.171209 Jun 07 13:18:51.496510 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 347/694] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:51 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:52.513392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e9a677bf-7517-4a0b-a690-93fe0a5ea5c5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:52.514061 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-e9a677bf-7517-4a0b-a690-93fe0a5ea5c5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:52.520644 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e9a677bf-7517-4a0b-a690-93fe0a5ea5c5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:52.521086 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e9a677bf-7517-4a0b-a690-93fe0a5ea5c5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:52.521831 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e9a677bf-7517-4a0b-a690-93fe0a5ea5c5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:52.522555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e9a677bf-7517-4a0b-a690-93fe0a5ea5c5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:52.648523 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e9a677bf-7517-4a0b-a690-93fe0a5ea5c5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:52.660626 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e9a677bf-7517-4a0b-a690-93fe0a5ea5c5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:52.662309 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e9a677bf-7517-4a0b-a690-93fe0a5ea5c5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:52.663676 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e9a677bf-7517-4a0b-a690-93fe0a5ea5c5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.154034 Jun 07 13:18:52.667022 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 348/695] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:52 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:53.682891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-828f6c8f-735e-418b-9ea2-c9f25a16dc23 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:53.683502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-828f6c8f-735e-418b-9ea2-c9f25a16dc23 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:53.689987 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-828f6c8f-735e-418b-9ea2-c9f25a16dc23 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:53.690459 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-828f6c8f-735e-418b-9ea2-c9f25a16dc23 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:53.691219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-828f6c8f-735e-418b-9ea2-c9f25a16dc23 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:53.691653 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-828f6c8f-735e-418b-9ea2-c9f25a16dc23 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:53.815409 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-828f6c8f-735e-418b-9ea2-c9f25a16dc23 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:53.823676 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-828f6c8f-735e-418b-9ea2-c9f25a16dc23 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:53.825192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-828f6c8f-735e-418b-9ea2-c9f25a16dc23 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:53.826359 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-828f6c8f-735e-418b-9ea2-c9f25a16dc23 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.147377 Jun 07 13:18:53.826946 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 348/696] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:53 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:54.847903 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-22ae7311-2fb6-4641-913e-6032c70047c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:54.848532 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-22ae7311-2fb6-4641-913e-6032c70047c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:54.866562 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-22ae7311-2fb6-4641-913e-6032c70047c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:54.867293 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-22ae7311-2fb6-4641-913e-6032c70047c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:54.868824 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-22ae7311-2fb6-4641-913e-6032c70047c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:54.869455 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-22ae7311-2fb6-4641-913e-6032c70047c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:55.005706 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-22ae7311-2fb6-4641-913e-6032c70047c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:55.013977 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-22ae7311-2fb6-4641-913e-6032c70047c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:55.015568 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-22ae7311-2fb6-4641-913e-6032c70047c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:55.017195 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-22ae7311-2fb6-4641-913e-6032c70047c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.173615 Jun 07 13:18:55.017748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 349/697] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:54 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:56.037160 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-76e8af72-0f41-4b22-8031-f903854ad2c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:56.038736 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-76e8af72-0f41-4b22-8031-f903854ad2c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:56.048184 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-76e8af72-0f41-4b22-8031-f903854ad2c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:56.048723 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-76e8af72-0f41-4b22-8031-f903854ad2c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:56.049578 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-76e8af72-0f41-4b22-8031-f903854ad2c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:56.050090 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-76e8af72-0f41-4b22-8031-f903854ad2c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:56.192299 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-76e8af72-0f41-4b22-8031-f903854ad2c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:56.200767 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-76e8af72-0f41-4b22-8031-f903854ad2c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:56.202260 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-76e8af72-0f41-4b22-8031-f903854ad2c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:56.203451 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-76e8af72-0f41-4b22-8031-f903854ad2c9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.172920 Jun 07 13:18:56.204676 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 349/698] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:56 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:57.222101 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-357bb177-c012-4758-b90e-5bdebbac7421 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:57.222748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-357bb177-c012-4758-b90e-5bdebbac7421 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:57.229204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-357bb177-c012-4758-b90e-5bdebbac7421 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:57.229646 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-357bb177-c012-4758-b90e-5bdebbac7421 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:57.230406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-357bb177-c012-4758-b90e-5bdebbac7421 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:57.230864 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-357bb177-c012-4758-b90e-5bdebbac7421 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:57.361628 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-357bb177-c012-4758-b90e-5bdebbac7421 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:57.370092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-357bb177-c012-4758-b90e-5bdebbac7421 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:57.371607 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-357bb177-c012-4758-b90e-5bdebbac7421 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:57.372735 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-357bb177-c012-4758-b90e-5bdebbac7421 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.155013 Jun 07 13:18:57.373385 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 350/699] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:57 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:18:58.391098 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-166476be-eb8f-4397-babf-9e8dc6bebc47 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:58.391757 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-166476be-eb8f-4397-babf-9e8dc6bebc47 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:58.394008 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=42 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:58.399230 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-166476be-eb8f-4397-babf-9e8dc6bebc47 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:58.399753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-166476be-eb8f-4397-babf-9e8dc6bebc47 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:58.400537 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-166476be-eb8f-4397-babf-9e8dc6bebc47 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:58.400970 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-166476be-eb8f-4397-babf-9e8dc6bebc47 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:58.532749 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-166476be-eb8f-4397-babf-9e8dc6bebc47 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:58.541171 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-166476be-eb8f-4397-babf-9e8dc6bebc47 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:58.542717 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-166476be-eb8f-4397-babf-9e8dc6bebc47 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:58.543989 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-166476be-eb8f-4397-babf-9e8dc6bebc47 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.156682 Jun 07 13:18:58.544671 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 350/700] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:58 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:59.563710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-dea268bf-bc54-4dd4-96c5-532418b3c902 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:59.564319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-dea268bf-bc54-4dd4-96c5-532418b3c902 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:59.570830 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dea268bf-bc54-4dd4-96c5-532418b3c902 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:59.571284 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dea268bf-bc54-4dd4-96c5-532418b3c902 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:59.572049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dea268bf-bc54-4dd4-96c5-532418b3c902 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:59.572484 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dea268bf-bc54-4dd4-96c5-532418b3c902 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:59.704718 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-dea268bf-bc54-4dd4-96c5-532418b3c902 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:59.713429 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-dea268bf-bc54-4dd4-96c5-532418b3c902 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:59.714954 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-dea268bf-bc54-4dd4-96c5-532418b3c902 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:59.716095 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-dea268bf-bc54-4dd4-96c5-532418b3c902 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.156903 Jun 07 13:18:59.716647 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 351/701] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:59 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:00.734983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6c510067-938b-4c8d-ad08-569e29ca5f89 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:00.735597 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6c510067-938b-4c8d-ad08-569e29ca5f89 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:00.742085 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c510067-938b-4c8d-ad08-569e29ca5f89 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:00.742595 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c510067-938b-4c8d-ad08-569e29ca5f89 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:00.743489 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c510067-938b-4c8d-ad08-569e29ca5f89 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:00.743932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c510067-938b-4c8d-ad08-569e29ca5f89 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:00.884951 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6c510067-938b-4c8d-ad08-569e29ca5f89 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:00.894712 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6c510067-938b-4c8d-ad08-569e29ca5f89 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:00.896207 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6c510067-938b-4c8d-ad08-569e29ca5f89 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:00.897517 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6c510067-938b-4c8d-ad08-569e29ca5f89 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.166435 Jun 07 13:19:00.898265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 351/702] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:00 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:01.090405 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0a7a838e-8fa2-4bcd-9e6c-d846dcf9b0f3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4fb002c-f95c-4bd5-bc3c-086a1b2d6d7b"}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:01.091481 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0a7a838e-8fa2-4bcd-9e6c-d846dcf9b0f3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:01.098581 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0a7a838e-8fa2-4bcd-9e6c-d846dcf9b0f3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:01.099028 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0a7a838e-8fa2-4bcd-9e6c-d846dcf9b0f3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:01.099787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0a7a838e-8fa2-4bcd-9e6c-d846dcf9b0f3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:01.100223 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0a7a838e-8fa2-4bcd-9e6c-d846dcf9b0f3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:01.916655 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-366c5037-8f76-4884-b9df-17be0ddce0f3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:01.917284 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-366c5037-8f76-4884-b9df-17be0ddce0f3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:01.923901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-366c5037-8f76-4884-b9df-17be0ddce0f3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:01.924333 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-366c5037-8f76-4884-b9df-17be0ddce0f3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:01.925152 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-366c5037-8f76-4884-b9df-17be0ddce0f3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:01.925590 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-366c5037-8f76-4884-b9df-17be0ddce0f3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:02.056488 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-366c5037-8f76-4884-b9df-17be0ddce0f3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:02.065020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-366c5037-8f76-4884-b9df-17be0ddce0f3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:02.066537 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-366c5037-8f76-4884-b9df-17be0ddce0f3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:02.067686 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-366c5037-8f76-4884-b9df-17be0ddce0f3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.155044 Jun 07 13:19:02.068254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 352/703] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:01 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:03.085736 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b226c984-4633-4f4b-a93c-d3dc5a400a64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:03.086352 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b226c984-4633-4f4b-a93c-d3dc5a400a64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:03.092816 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b226c984-4633-4f4b-a93c-d3dc5a400a64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:03.093269 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b226c984-4633-4f4b-a93c-d3dc5a400a64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:03.094028 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b226c984-4633-4f4b-a93c-d3dc5a400a64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:03.094487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b226c984-4633-4f4b-a93c-d3dc5a400a64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:03.217879 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b226c984-4633-4f4b-a93c-d3dc5a400a64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:03.226622 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b226c984-4633-4f4b-a93c-d3dc5a400a64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:03.228141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b226c984-4633-4f4b-a93c-d3dc5a400a64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:03.229299 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b226c984-4633-4f4b-a93c-d3dc5a400a64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.147434 Jun 07 13:19:03.229854 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 353/704] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:03 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:04.247313 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b2147723-97cb-4f2d-a4d0-8febf6448266 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:04.248014 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b2147723-97cb-4f2d-a4d0-8febf6448266 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:04.254733 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b2147723-97cb-4f2d-a4d0-8febf6448266 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:04.255181 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b2147723-97cb-4f2d-a4d0-8febf6448266 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:04.255932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b2147723-97cb-4f2d-a4d0-8febf6448266 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:04.256360 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b2147723-97cb-4f2d-a4d0-8febf6448266 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:04.386512 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b2147723-97cb-4f2d-a4d0-8febf6448266 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:04.395577 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b2147723-97cb-4f2d-a4d0-8febf6448266 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:04.396975 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b2147723-97cb-4f2d-a4d0-8febf6448266 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:04.398111 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b2147723-97cb-4f2d-a4d0-8febf6448266 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.154651 Jun 07 13:19:04.398690 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 354/705] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:04 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:05.416568 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6d364ac9-d391-4970-9020-84d40667d02b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:05.417255 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6d364ac9-d391-4970-9020-84d40667d02b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:05.424297 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6d364ac9-d391-4970-9020-84d40667d02b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:05.424744 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6d364ac9-d391-4970-9020-84d40667d02b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:05.425505 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6d364ac9-d391-4970-9020-84d40667d02b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:05.425936 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6d364ac9-d391-4970-9020-84d40667d02b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:05.553882 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6d364ac9-d391-4970-9020-84d40667d02b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:05.562242 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6d364ac9-d391-4970-9020-84d40667d02b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:05.563817 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6d364ac9-d391-4970-9020-84d40667d02b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:05.564962 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6d364ac9-d391-4970-9020-84d40667d02b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.152340 Jun 07 13:19:05.565515 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 355/706] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:05 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:06.684472 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-88038838-7178-4673-9f85-6c9b49c9d777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:06.685079 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-88038838-7178-4673-9f85-6c9b49c9d777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:06.691039 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-88038838-7178-4673-9f85-6c9b49c9d777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:06.691478 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-88038838-7178-4673-9f85-6c9b49c9d777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:06.692222 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-88038838-7178-4673-9f85-6c9b49c9d777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:06.692649 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-88038838-7178-4673-9f85-6c9b49c9d777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:06.825767 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-88038838-7178-4673-9f85-6c9b49c9d777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:06.834169 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-88038838-7178-4673-9f85-6c9b49c9d777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:06.835744 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-88038838-7178-4673-9f85-6c9b49c9d777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:06.836832 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-88038838-7178-4673-9f85-6c9b49c9d777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.257714 Jun 07 13:19:06.837378 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 356/707] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:06 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:07.381031 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0a7a838e-8fa2-4bcd-9e6c-d846dcf9b0f3 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "POST /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.294288 Jun 07 13:19:07.383034 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 352/708] 10.222.0.58 () {60 vars in 1322 bytes} [Tue Jun 7 13:19:01 2022] POST /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-volume_attachments => generated 194 bytes in 6297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:07.855538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3c58bf06-df1e-4f61-ba85-48371f72dffe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:07.856156 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3c58bf06-df1e-4f61-ba85-48371f72dffe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:07.864849 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c58bf06-df1e-4f61-ba85-48371f72dffe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:07.865667 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c58bf06-df1e-4f61-ba85-48371f72dffe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:07.866876 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c58bf06-df1e-4f61-ba85-48371f72dffe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:07.867319 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c58bf06-df1e-4f61-ba85-48371f72dffe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:08.006767 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3c58bf06-df1e-4f61-ba85-48371f72dffe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:08.013707 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3c58bf06-df1e-4f61-ba85-48371f72dffe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:08.015245 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3c58bf06-df1e-4f61-ba85-48371f72dffe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:08.016487 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3c58bf06-df1e-4f61-ba85-48371f72dffe tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.165049 Jun 07 13:19:08.017070 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 357/709] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:07 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:09.035416 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-55cd0f2f-37fe-4ff9-bf93-b7afbdceb45f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:09.036042 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-55cd0f2f-37fe-4ff9-bf93-b7afbdceb45f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:09.037969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=34 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:09.044273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-55cd0f2f-37fe-4ff9-bf93-b7afbdceb45f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:09.044727 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-55cd0f2f-37fe-4ff9-bf93-b7afbdceb45f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:09.045488 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-55cd0f2f-37fe-4ff9-bf93-b7afbdceb45f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:09.045923 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-55cd0f2f-37fe-4ff9-bf93-b7afbdceb45f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:09.174956 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-55cd0f2f-37fe-4ff9-bf93-b7afbdceb45f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:09.183315 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-55cd0f2f-37fe-4ff9-bf93-b7afbdceb45f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:09.184829 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-55cd0f2f-37fe-4ff9-bf93-b7afbdceb45f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:09.185969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-55cd0f2f-37fe-4ff9-bf93-b7afbdceb45f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.155697 Jun 07 13:19:09.186545 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 353/710] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:09 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:10.204224 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-043fec71-f47e-467c-a6fb-a363736b738c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:10.204763 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-043fec71-f47e-467c-a6fb-a363736b738c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:10.211922 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-043fec71-f47e-467c-a6fb-a363736b738c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:10.212375 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-043fec71-f47e-467c-a6fb-a363736b738c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:10.213137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-043fec71-f47e-467c-a6fb-a363736b738c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:10.213573 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-043fec71-f47e-467c-a6fb-a363736b738c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:10.337237 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-043fec71-f47e-467c-a6fb-a363736b738c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:10.345628 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-043fec71-f47e-467c-a6fb-a363736b738c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:10.347769 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-043fec71-f47e-467c-a6fb-a363736b738c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:10.348926 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-043fec71-f47e-467c-a6fb-a363736b738c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.148790 Jun 07 13:19:10.349495 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 358/711] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:10 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:11.367414 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0c961c3f-993b-4a8a-b89a-03d57a32f68e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:11.368019 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0c961c3f-993b-4a8a-b89a-03d57a32f68e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:11.374554 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0c961c3f-993b-4a8a-b89a-03d57a32f68e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:11.375006 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0c961c3f-993b-4a8a-b89a-03d57a32f68e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:11.375763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0c961c3f-993b-4a8a-b89a-03d57a32f68e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:11.376199 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0c961c3f-993b-4a8a-b89a-03d57a32f68e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:11.380065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:11.510608 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0c961c3f-993b-4a8a-b89a-03d57a32f68e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:11.519710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0c961c3f-993b-4a8a-b89a-03d57a32f68e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:11.521210 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0c961c3f-993b-4a8a-b89a-03d57a32f68e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:11.522360 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0c961c3f-993b-4a8a-b89a-03d57a32f68e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.158808 Jun 07 13:19:11.522959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 354/712] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:11 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:12.540938 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e19b9ac1-29e2-4682-abbb-e805469f3b65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:12.541552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e19b9ac1-29e2-4682-abbb-e805469f3b65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:12.547750 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e19b9ac1-29e2-4682-abbb-e805469f3b65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:12.548201 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e19b9ac1-29e2-4682-abbb-e805469f3b65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:12.549461 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e19b9ac1-29e2-4682-abbb-e805469f3b65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:12.549895 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e19b9ac1-29e2-4682-abbb-e805469f3b65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:12.678643 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e19b9ac1-29e2-4682-abbb-e805469f3b65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:12.687023 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e19b9ac1-29e2-4682-abbb-e805469f3b65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:12.688538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e19b9ac1-29e2-4682-abbb-e805469f3b65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:12.689693 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e19b9ac1-29e2-4682-abbb-e805469f3b65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.152894 Jun 07 13:19:12.690250 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 359/713] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:12 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:13.708505 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d9e02b3f-6641-4ee6-95ef-904dcf18e985 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:13.709115 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d9e02b3f-6641-4ee6-95ef-904dcf18e985 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:13.715645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d9e02b3f-6641-4ee6-95ef-904dcf18e985 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:13.716094 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d9e02b3f-6641-4ee6-95ef-904dcf18e985 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:13.716856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d9e02b3f-6641-4ee6-95ef-904dcf18e985 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:13.717297 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d9e02b3f-6641-4ee6-95ef-904dcf18e985 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:13.842998 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d9e02b3f-6641-4ee6-95ef-904dcf18e985 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:13.851867 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d9e02b3f-6641-4ee6-95ef-904dcf18e985 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:13.853348 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d9e02b3f-6641-4ee6-95ef-904dcf18e985 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:13.854491 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d9e02b3f-6641-4ee6-95ef-904dcf18e985 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.150582 Jun 07 13:19:13.855047 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 355/714] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:13 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:14.872661 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-da4a4546-b58e-4bf0-8b27-9054a144775e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:14.873274 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-da4a4546-b58e-4bf0-8b27-9054a144775e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:14.879818 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da4a4546-b58e-4bf0-8b27-9054a144775e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:14.880274 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da4a4546-b58e-4bf0-8b27-9054a144775e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:14.881036 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da4a4546-b58e-4bf0-8b27-9054a144775e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:14.881478 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da4a4546-b58e-4bf0-8b27-9054a144775e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:15.006098 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-da4a4546-b58e-4bf0-8b27-9054a144775e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:15.014619 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-da4a4546-b58e-4bf0-8b27-9054a144775e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:15.016138 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-da4a4546-b58e-4bf0-8b27-9054a144775e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:15.017287 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-da4a4546-b58e-4bf0-8b27-9054a144775e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.148520 Jun 07 13:19:15.017886 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 360/715] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:14 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:15.940239 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d2d0af24-6eb2-4c26-97f8-cfb70e726c17 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:15.941232 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d2d0af24-6eb2-4c26-97f8-cfb70e726c17 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:15.947579 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d2d0af24-6eb2-4c26-97f8-cfb70e726c17 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:15.948034 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d2d0af24-6eb2-4c26-97f8-cfb70e726c17 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:15.948795 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d2d0af24-6eb2-4c26-97f8-cfb70e726c17 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:15.949235 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d2d0af24-6eb2-4c26-97f8-cfb70e726c17 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:15.972559 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-d2d0af24-6eb2-4c26-97f8-cfb70e726c17 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lazy-loading 'flavor' on Instance uuid bfc2b109-2c98-4fdc-b735-5df0ced46167 {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:19:16.035364 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e406127d-4cfa-4004-889c-270bcffd7286 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:16.035975 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e406127d-4cfa-4004-889c-270bcffd7286 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:16.042343 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e406127d-4cfa-4004-889c-270bcffd7286 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:16.042833 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e406127d-4cfa-4004-889c-270bcffd7286 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:16.043595 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e406127d-4cfa-4004-889c-270bcffd7286 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:16.044028 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e406127d-4cfa-4004-889c-270bcffd7286 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:16.094718 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d2d0af24-6eb2-4c26-97f8-cfb70e726c17 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "POST /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/action" status: 200 len: 32 microversion: 2.1 time: 0.158696 Jun 07 13:19:16.095290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 356/716] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jun 7 13:19:15 2022] POST /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:19:16.104620 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e6022ddf-272f-47b5-87dc-b18222b64fc0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:16.105424 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-e6022ddf-272f-47b5-87dc-b18222b64fc0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:16.112632 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e6022ddf-272f-47b5-87dc-b18222b64fc0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:16.113267 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e6022ddf-272f-47b5-87dc-b18222b64fc0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:16.114054 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e6022ddf-272f-47b5-87dc-b18222b64fc0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:16.114550 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e6022ddf-272f-47b5-87dc-b18222b64fc0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:16.263310 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e406127d-4cfa-4004-889c-270bcffd7286 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:16.265662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e6022ddf-272f-47b5-87dc-b18222b64fc0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:16.266242 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:16.274900 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e6022ddf-272f-47b5-87dc-b18222b64fc0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.174220 Jun 07 13:19:16.277274 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e406127d-4cfa-4004-889c-270bcffd7286 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:16.280167 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e406127d-4cfa-4004-889c-270bcffd7286 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:16.282028 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e406127d-4cfa-4004-889c-270bcffd7286 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.250453 Jun 07 13:19:16.283792 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 361/717] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:16 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:16.286911 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 357/718] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:16 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:17.292930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b9874808-9c07-4e24-a065-cfe4f73e738e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:17.293571 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b9874808-9c07-4e24-a065-cfe4f73e738e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:17.300848 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b9874808-9c07-4e24-a065-cfe4f73e738e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:17.301301 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b9874808-9c07-4e24-a065-cfe4f73e738e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:17.301425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-13865abd-a02f-47ea-bdb7-c8dc5187f186 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:17.301961 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-13865abd-a02f-47ea-bdb7-c8dc5187f186 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:17.302109 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b9874808-9c07-4e24-a065-cfe4f73e738e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:17.302501 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b9874808-9c07-4e24-a065-cfe4f73e738e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:17.308375 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-13865abd-a02f-47ea-bdb7-c8dc5187f186 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:17.308829 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-13865abd-a02f-47ea-bdb7-c8dc5187f186 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:17.309595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-13865abd-a02f-47ea-bdb7-c8dc5187f186 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:17.310032 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-13865abd-a02f-47ea-bdb7-c8dc5187f186 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:17.434860 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b9874808-9c07-4e24-a065-cfe4f73e738e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:17.437157 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-13865abd-a02f-47ea-bdb7-c8dc5187f186 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:17.442843 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b9874808-9c07-4e24-a065-cfe4f73e738e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.153644 Jun 07 13:19:17.443414 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 362/719] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:17 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:17.445499 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-13865abd-a02f-47ea-bdb7-c8dc5187f186 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:17.447044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-13865abd-a02f-47ea-bdb7-c8dc5187f186 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:17.448195 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-13865abd-a02f-47ea-bdb7-c8dc5187f186 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.151275 Jun 07 13:19:17.448736 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 358/720] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:17 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:18.459344 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-0f49b403-908c-4ecd-8da4-68ef7e218466 req-e8f3f618-2746-4cd6-a978-b84f6a8ac4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64eec94b-9fac-4ad4-8386-01a27db4d5ce", "name": "network-vif-plugged", "status": "completed", "tag": "689501bc-bf08-4b3c-8c94-bc415ab172a1"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:18.467067 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d762fff2-f372-4736-a5cd-9011520d0230 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:18.467740 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d762fff2-f372-4736-a5cd-9011520d0230 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:18.468771 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-0f49b403-908c-4ecd-8da4-68ef7e218466 req-e8f3f618-2746-4cd6-a978-b84f6a8ac4ba service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:18.469221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-0f49b403-908c-4ecd-8da4-68ef7e218466 req-e8f3f618-2746-4cd6-a978-b84f6a8ac4ba service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:18.474502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d762fff2-f372-4736-a5cd-9011520d0230 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:18.474964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d762fff2-f372-4736-a5cd-9011520d0230 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:18.475765 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d762fff2-f372-4736-a5cd-9011520d0230 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:18.476203 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d762fff2-f372-4736-a5cd-9011520d0230 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:18.482459 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-0f49b403-908c-4ecd-8da4-68ef7e218466 req-e8f3f618-2746-4cd6-a978-b84f6a8ac4ba service nova] Creating event network-vif-plugged:689501bc-bf08-4b3c-8c94-bc415ab172a1 for instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce on hv-cinder-84496 Jun 07 13:19:18.488328 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-0f49b403-908c-4ecd-8da4-68ef7e218466 req-e8f3f618-2746-4cd6-a978-b84f6a8ac4ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032568 Jun 07 13:19:18.489110 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 359/721] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:19:18.495094 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-90e78d1c-31f8-4028-8e76-6a013855aeda tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:18.495341 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-90e78d1c-31f8-4028-8e76-6a013855aeda tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:18.501457 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-90e78d1c-31f8-4028-8e76-6a013855aeda tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:18.502580 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-90e78d1c-31f8-4028-8e76-6a013855aeda tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:18.503359 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-90e78d1c-31f8-4028-8e76-6a013855aeda tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:18.503803 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-90e78d1c-31f8-4028-8e76-6a013855aeda tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:18.626158 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d762fff2-f372-4736-a5cd-9011520d0230 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:18.634297 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d762fff2-f372-4736-a5cd-9011520d0230 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.171846 Jun 07 13:19:18.634905 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 363/722] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:18 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:18.648536 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-90e78d1c-31f8-4028-8e76-6a013855aeda tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:18.657439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-90e78d1c-31f8-4028-8e76-6a013855aeda tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:18.659566 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-90e78d1c-31f8-4028-8e76-6a013855aeda tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:18.661203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-90e78d1c-31f8-4028-8e76-6a013855aeda tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.170596 Jun 07 13:19:18.661849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 360/723] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:18 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:19.651425 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c3cbada1-be88-413f-9501-f47b60b388ac tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:19.652040 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c3cbada1-be88-413f-9501-f47b60b388ac tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:19.659219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3cbada1-be88-413f-9501-f47b60b388ac tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:19.659697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3cbada1-be88-413f-9501-f47b60b388ac tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:19.660507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3cbada1-be88-413f-9501-f47b60b388ac tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:19.661120 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3cbada1-be88-413f-9501-f47b60b388ac tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:19.679769 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e2ed4b60-8431-4a7d-ae02-17268525105f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:19.680469 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-e2ed4b60-8431-4a7d-ae02-17268525105f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:19.687144 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e2ed4b60-8431-4a7d-ae02-17268525105f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:19.687588 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e2ed4b60-8431-4a7d-ae02-17268525105f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:19.688350 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e2ed4b60-8431-4a7d-ae02-17268525105f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:19.688787 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e2ed4b60-8431-4a7d-ae02-17268525105f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:19.790179 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c3cbada1-be88-413f-9501-f47b60b388ac tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:19.798053 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c3cbada1-be88-413f-9501-f47b60b388ac tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.150510 Jun 07 13:19:19.798651 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 364/724] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:19 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:19.814870 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e2ed4b60-8431-4a7d-ae02-17268525105f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:19.823154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e2ed4b60-8431-4a7d-ae02-17268525105f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:19.824647 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e2ed4b60-8431-4a7d-ae02-17268525105f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:19.825778 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e2ed4b60-8431-4a7d-ae02-17268525105f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.150394 Jun 07 13:19:19.826322 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 361/725] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:19 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:20.815841 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-44cc3a49-f97e-4c73-b7d6-47be20a1d045 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:20.816508 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-44cc3a49-f97e-4c73-b7d6-47be20a1d045 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:20.823125 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-44cc3a49-f97e-4c73-b7d6-47be20a1d045 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:20.823577 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-44cc3a49-f97e-4c73-b7d6-47be20a1d045 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:20.824345 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-44cc3a49-f97e-4c73-b7d6-47be20a1d045 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:20.824782 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-44cc3a49-f97e-4c73-b7d6-47be20a1d045 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:20.844148 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-6d1a978c-9a3b-4092-a2ff-d5a44b26373f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:20.844754 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-6d1a978c-9a3b-4092-a2ff-d5a44b26373f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:20.851585 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6d1a978c-9a3b-4092-a2ff-d5a44b26373f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:20.852034 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6d1a978c-9a3b-4092-a2ff-d5a44b26373f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:20.852783 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6d1a978c-9a3b-4092-a2ff-d5a44b26373f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:20.853214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6d1a978c-9a3b-4092-a2ff-d5a44b26373f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:20.951452 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-44cc3a49-f97e-4c73-b7d6-47be20a1d045 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:20.959325 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-44cc3a49-f97e-4c73-b7d6-47be20a1d045 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.148031 Jun 07 13:19:20.959892 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 365/726] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:20 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:20.986201 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-6d1a978c-9a3b-4092-a2ff-d5a44b26373f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:20.995235 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-6d1a978c-9a3b-4092-a2ff-d5a44b26373f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:20.996738 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-6d1a978c-9a3b-4092-a2ff-d5a44b26373f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:20.997899 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-6d1a978c-9a3b-4092-a2ff-d5a44b26373f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1807 microversion: 2.20 time: 0.157605 Jun 07 13:19:20.998487 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 362/727] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:20 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:21.977216 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-efd5f1d5-153e-42c8-ad4f-683130835f10 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:21.977777 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-efd5f1d5-153e-42c8-ad4f-683130835f10 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:21.984137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-efd5f1d5-153e-42c8-ad4f-683130835f10 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:21.984588 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-efd5f1d5-153e-42c8-ad4f-683130835f10 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:21.985349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-efd5f1d5-153e-42c8-ad4f-683130835f10 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:21.985788 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-efd5f1d5-153e-42c8-ad4f-683130835f10 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:22.015277 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-df34c84f-4c7a-4e99-98bf-6572b25fd60f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:22.015912 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-df34c84f-4c7a-4e99-98bf-6572b25fd60f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:22.022418 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-df34c84f-4c7a-4e99-98bf-6572b25fd60f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:22.022892 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-df34c84f-4c7a-4e99-98bf-6572b25fd60f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:22.023654 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-df34c84f-4c7a-4e99-98bf-6572b25fd60f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:22.024087 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-df34c84f-4c7a-4e99-98bf-6572b25fd60f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:22.116055 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-efd5f1d5-153e-42c8-ad4f-683130835f10 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:22.124481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-efd5f1d5-153e-42c8-ad4f-683130835f10 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.151215 Jun 07 13:19:22.125053 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 366/728] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:21 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:22.151717 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-df34c84f-4c7a-4e99-98bf-6572b25fd60f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:22.160634 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-df34c84f-4c7a-4e99-98bf-6572b25fd60f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:22.162200 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-df34c84f-4c7a-4e99-98bf-6572b25fd60f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:22.163378 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-df34c84f-4c7a-4e99-98bf-6572b25fd60f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1794 microversion: 2.20 time: 0.151983 Jun 07 13:19:22.163966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 363/729] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:22 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1794 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:23.141683 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c6e65687-7285-4ff3-8a3b-a5c1efa598ee tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:23.142296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c6e65687-7285-4ff3-8a3b-a5c1efa598ee tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:23.149435 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c6e65687-7285-4ff3-8a3b-a5c1efa598ee tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:23.149888 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c6e65687-7285-4ff3-8a3b-a5c1efa598ee tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:23.150679 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c6e65687-7285-4ff3-8a3b-a5c1efa598ee tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:23.151123 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c6e65687-7285-4ff3-8a3b-a5c1efa598ee tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:23.275002 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c6e65687-7285-4ff3-8a3b-a5c1efa598ee tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:23.283142 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c6e65687-7285-4ff3-8a3b-a5c1efa598ee tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.145279 Jun 07 13:19:23.283716 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 367/730] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:23 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:24.299111 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-49b6d3e1-2eb1-4eaa-8991-328c11d39966 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:24.299721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-49b6d3e1-2eb1-4eaa-8991-328c11d39966 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:24.306244 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-49b6d3e1-2eb1-4eaa-8991-328c11d39966 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:24.306735 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-49b6d3e1-2eb1-4eaa-8991-328c11d39966 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:24.307497 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-49b6d3e1-2eb1-4eaa-8991-328c11d39966 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:24.307934 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-49b6d3e1-2eb1-4eaa-8991-328c11d39966 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:24.433436 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-49b6d3e1-2eb1-4eaa-8991-328c11d39966 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:24.441254 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-49b6d3e1-2eb1-4eaa-8991-328c11d39966 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.145981 Jun 07 13:19:24.441809 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 364/731] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:24 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:25.458292 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1707a9b7-c1bb-4703-b4f4-7b9acd754a96 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:25.458868 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1707a9b7-c1bb-4703-b4f4-7b9acd754a96 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:25.465350 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1707a9b7-c1bb-4703-b4f4-7b9acd754a96 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:25.465799 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1707a9b7-c1bb-4703-b4f4-7b9acd754a96 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:25.466590 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1707a9b7-c1bb-4703-b4f4-7b9acd754a96 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:25.467030 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1707a9b7-c1bb-4703-b4f4-7b9acd754a96 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:25.597627 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1707a9b7-c1bb-4703-b4f4-7b9acd754a96 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:25.605589 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1707a9b7-c1bb-4703-b4f4-7b9acd754a96 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.151194 Jun 07 13:19:25.606148 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 368/732] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:25 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:26.623124 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-97d655ed-8307-45da-a8f4-4a7ec464a426 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:26.623740 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-97d655ed-8307-45da-a8f4-4a7ec464a426 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:26.630956 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-97d655ed-8307-45da-a8f4-4a7ec464a426 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:26.631405 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-97d655ed-8307-45da-a8f4-4a7ec464a426 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:26.632176 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-97d655ed-8307-45da-a8f4-4a7ec464a426 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:26.632599 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-97d655ed-8307-45da-a8f4-4a7ec464a426 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:26.956812 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-97d655ed-8307-45da-a8f4-4a7ec464a426 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:26.964967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-97d655ed-8307-45da-a8f4-4a7ec464a426 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.345661 Jun 07 13:19:26.965530 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 365/733] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:26 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:27.981845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-28a4dc1c-c63a-41bb-8c68-bcf2d6447290 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:27.982477 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-28a4dc1c-c63a-41bb-8c68-bcf2d6447290 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:27.989503 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-28a4dc1c-c63a-41bb-8c68-bcf2d6447290 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:27.989980 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-28a4dc1c-c63a-41bb-8c68-bcf2d6447290 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:27.990783 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-28a4dc1c-c63a-41bb-8c68-bcf2d6447290 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:27.991224 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-28a4dc1c-c63a-41bb-8c68-bcf2d6447290 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:28.116808 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-28a4dc1c-c63a-41bb-8c68-bcf2d6447290 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:28.124849 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-28a4dc1c-c63a-41bb-8c68-bcf2d6447290 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.146930 Jun 07 13:19:28.125419 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 369/734] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:27 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:29.141295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-4a49c639-9fd8-4ae2-b962-405df25094a2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:29.141902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-4a49c639-9fd8-4ae2-b962-405df25094a2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:29.148960 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4a49c639-9fd8-4ae2-b962-405df25094a2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:29.149404 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4a49c639-9fd8-4ae2-b962-405df25094a2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:29.150161 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4a49c639-9fd8-4ae2-b962-405df25094a2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:29.150621 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4a49c639-9fd8-4ae2-b962-405df25094a2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:29.275778 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-4a49c639-9fd8-4ae2-b962-405df25094a2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:29.283870 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-4a49c639-9fd8-4ae2-b962-405df25094a2 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.146449 Jun 07 13:19:29.284433 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 366/735] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:29 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:30.301112 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3eed9072-f042-4f8c-9bca-2cdd9ca70b56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:30.301693 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3eed9072-f042-4f8c-9bca-2cdd9ca70b56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:30.304028 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=40 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:30.309153 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3eed9072-f042-4f8c-9bca-2cdd9ca70b56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:30.309598 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3eed9072-f042-4f8c-9bca-2cdd9ca70b56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:30.310375 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3eed9072-f042-4f8c-9bca-2cdd9ca70b56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:30.310827 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3eed9072-f042-4f8c-9bca-2cdd9ca70b56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:30.438011 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3eed9072-f042-4f8c-9bca-2cdd9ca70b56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:30.446587 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3eed9072-f042-4f8c-9bca-2cdd9ca70b56 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.149826 Jun 07 13:19:30.447154 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 370/736] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:30 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:31.463160 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3e04693c-6bfc-4b9d-ac2c-0409b8e92241 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:31.463975 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3e04693c-6bfc-4b9d-ac2c-0409b8e92241 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:31.470412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3e04693c-6bfc-4b9d-ac2c-0409b8e92241 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:31.470876 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3e04693c-6bfc-4b9d-ac2c-0409b8e92241 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:31.471625 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3e04693c-6bfc-4b9d-ac2c-0409b8e92241 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:31.472057 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3e04693c-6bfc-4b9d-ac2c-0409b8e92241 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:31.599459 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3e04693c-6bfc-4b9d-ac2c-0409b8e92241 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:31.607254 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3e04693c-6bfc-4b9d-ac2c-0409b8e92241 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.147878 Jun 07 13:19:31.607808 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 367/737] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:31 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:32.623943 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f4d0954a-e162-491f-892f-1d03d8baf3d8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:32.624558 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f4d0954a-e162-491f-892f-1d03d8baf3d8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:32.631797 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f4d0954a-e162-491f-892f-1d03d8baf3d8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:32.632248 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f4d0954a-e162-491f-892f-1d03d8baf3d8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:32.633008 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f4d0954a-e162-491f-892f-1d03d8baf3d8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:32.633449 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f4d0954a-e162-491f-892f-1d03d8baf3d8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:32.758573 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f4d0954a-e162-491f-892f-1d03d8baf3d8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:32.766433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f4d0954a-e162-491f-892f-1d03d8baf3d8 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.146336 Jun 07 13:19:32.767032 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 371/738] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:32 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:33.783546 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-580de4c2-5074-4aa4-931a-7cff3498db9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:33.784154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-580de4c2-5074-4aa4-931a-7cff3498db9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:33.790645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-580de4c2-5074-4aa4-931a-7cff3498db9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:33.791099 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-580de4c2-5074-4aa4-931a-7cff3498db9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:33.791868 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-580de4c2-5074-4aa4-931a-7cff3498db9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:33.792300 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-580de4c2-5074-4aa4-931a-7cff3498db9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:33.916826 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-580de4c2-5074-4aa4-931a-7cff3498db9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:33.924714 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-580de4c2-5074-4aa4-931a-7cff3498db9f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.145305 Jun 07 13:19:33.925288 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 368/739] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:33 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:34.941489 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3551772d-3116-4b00-8d97-f3ae0de9bb92 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:34.942101 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3551772d-3116-4b00-8d97-f3ae0de9bb92 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:34.948691 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3551772d-3116-4b00-8d97-f3ae0de9bb92 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:34.949143 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3551772d-3116-4b00-8d97-f3ae0de9bb92 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:34.949906 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3551772d-3116-4b00-8d97-f3ae0de9bb92 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:34.950346 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3551772d-3116-4b00-8d97-f3ae0de9bb92 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:35.076520 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3551772d-3116-4b00-8d97-f3ae0de9bb92 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:35.084978 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3551772d-3116-4b00-8d97-f3ae0de9bb92 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.147307 Jun 07 13:19:35.085475 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 372/740] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:34 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:36.101947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9404b26f-311b-4118-bf9b-163741f617a6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:36.102504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9404b26f-311b-4118-bf9b-163741f617a6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:36.108890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9404b26f-311b-4118-bf9b-163741f617a6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:36.109331 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9404b26f-311b-4118-bf9b-163741f617a6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:36.110073 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9404b26f-311b-4118-bf9b-163741f617a6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:36.110526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9404b26f-311b-4118-bf9b-163741f617a6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:36.128392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:36.242706 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9404b26f-311b-4118-bf9b-163741f617a6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:36.250607 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9404b26f-311b-4118-bf9b-163741f617a6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1736 microversion: 2.1 time: 0.152530 Jun 07 13:19:36.251171 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 369/741] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:36 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:37.104445 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9729cdad-802c-45ed-a317-9a45c61f072b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:37.104939 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9729cdad-802c-45ed-a317-9a45c61f072b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:37.110850 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9729cdad-802c-45ed-a317-9a45c61f072b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.111299 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9729cdad-802c-45ed-a317-9a45c61f072b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.112054 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9729cdad-802c-45ed-a317-9a45c61f072b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.112489 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9729cdad-802c-45ed-a317-9a45c61f072b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.134266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9729cdad-802c-45ed-a317-9a45c61f072b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96/ips" status: 200 len: 148 microversion: 2.1 time: 0.132800 Jun 07 13:19:37.134834 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 373/742] 10.222.0.58 () {58 vars in 1247 bytes} [Tue Jun 7 13:19:37 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96/ips => generated 148 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:37.145769 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d17503ae-56d0-4327-96bc-e48121c36836 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "464914cf-2981-4b30-9de2-05ac3d8fe8c9"}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:37.146866 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d17503ae-56d0-4327-96bc-e48121c36836 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:37.153197 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d17503ae-56d0-4327-96bc-e48121c36836 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.153640 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d17503ae-56d0-4327-96bc-e48121c36836 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.154390 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d17503ae-56d0-4327-96bc-e48121c36836 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.154845 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d17503ae-56d0-4327-96bc-e48121c36836 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.231326 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-d17503ae-56d0-4327-96bc-e48121c36836 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] HTTP exception thrown: Invalid volume: volume 464914cf-2981-4b30-9de2-05ac3d8fe8c9 is already attached to instances: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d17503ae-56d0-4327-96bc-e48121c36836 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Request method failure captured: Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: POST /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96/os-volume_attachments HTTP/1.1 Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 74 Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08U-o1RXkpPvRpL7xDzNFmHnSj255NFDhEpduNc0925DPg27io8CB6KRvQZuxcGtY7Iz0iEoMVidEoHUACL1lIGmUyRUR_8aMLzRLJXAMtSSy6JOQkiG83CLgwqXPfpWRfIbnqNAok3xO_9QFcJIn-p7dfSyPkb5TLmEFYuzTkAq94 Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:19:37.233065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:19:37.234392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd6f908209c418490bccdbdef7691a5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:19:37.234392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:19:37.234392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:19:37.234392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:19:37.234392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:19:37.234392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:19:37.234392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:19:37.234392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 3f1a9bfb57f64b85b635c29090aa498c Jun 07 13:19:37.234392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:19:37.234392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Jun 07 13:19:37.234392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {"volumeAttachment": {"volumeId": "464914cf-2981-4b30-9de2-05ac3d8fe8c9"}} Jun 07 13:19:37.234392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Invalid volume: volume 464914cf-2981-4b30-9de2-05ac3d8fe8c9 is already attached to instances: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'server_id': '4a5728ed-f056-462a-952e-ce2c4fd06b96', 'body': {'volumeAttachment': {'volumeId': '464914cf-2981-4b30-9de2-05ac3d8fe8c9'}}} Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 464914cf-2981-4b30-9de2-05ac3d8fe8c9 is already attached to instances: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:37.235202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 464914cf-2981-4b30-9de2-05ac3d8fe8c9 is already attached to instances: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:37.236521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:37.238094 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:37.238094 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:19:37.238094 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:19:37.238094 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 464914cf-2981-4b30-9de2-05ac3d8fe8c9 is already attached to instances: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 Jun 07 13:19:37.238094 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:37.238094 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d17503ae-56d0-4327-96bc-e48121c36836 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Returning 400 to user: Invalid volume: volume 464914cf-2981-4b30-9de2-05ac3d8fe8c9 is already attached to instances: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:19:37.238094 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d17503ae-56d0-4327-96bc-e48121c36836 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "POST /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093288 Jun 07 13:19:37.238094 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 370/743] 10.222.0.58 () {60 vars in 1322 bytes} [Tue Jun 7 13:19:37 2022] POST /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:19:37.243360 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ee684263-bcae-4aae-9647-c29a356b6ca7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:37.243859 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ee684263-bcae-4aae-9647-c29a356b6ca7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:37.249768 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ee684263-bcae-4aae-9647-c29a356b6ca7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.250218 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ee684263-bcae-4aae-9647-c29a356b6ca7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.251018 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ee684263-bcae-4aae-9647-c29a356b6ca7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.251459 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ee684263-bcae-4aae-9647-c29a356b6ca7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.268313 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-89c17dd2-192f-496a-81bc-03cd00639b51 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:37.268919 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-89c17dd2-192f-496a-81bc-03cd00639b51 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:37.275886 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-89c17dd2-192f-496a-81bc-03cd00639b51 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.276269 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-89c17dd2-192f-496a-81bc-03cd00639b51 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.276441 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ee684263-bcae-4aae-9647-c29a356b6ca7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:19:37.277037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-89c17dd2-192f-496a-81bc-03cd00639b51 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.277468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-89c17dd2-192f-496a-81bc-03cd00639b51 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.354761 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ee684263-bcae-4aae-9647-c29a356b6ca7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 204 len: 0 microversion: 2.1 time: 0.114853 Jun 07 13:19:37.355385 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 374/744] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:19:37 2022] DELETE /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:19:37.363979 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fa33cc73-5b95-459e-a6f9-cffc7bf477ab tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:37.364675 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fa33cc73-5b95-459e-a6f9-cffc7bf477ab tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:37.370842 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fa33cc73-5b95-459e-a6f9-cffc7bf477ab tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.371427 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fa33cc73-5b95-459e-a6f9-cffc7bf477ab tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.372202 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fa33cc73-5b95-459e-a6f9-cffc7bf477ab tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.372642 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fa33cc73-5b95-459e-a6f9-cffc7bf477ab tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.416182 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-89c17dd2-192f-496a-81bc-03cd00639b51 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:37.424150 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-89c17dd2-192f-496a-81bc-03cd00639b51 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1716 microversion: 2.1 time: 0.159994 Jun 07 13:19:37.424719 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 371/745] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:37 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:37.478382 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ce4665c7-03de-4f3b-81fe-bbfdf93bfa6c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:37.478893 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ce4665c7-03de-4f3b-81fe-bbfdf93bfa6c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:37.484758 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce4665c7-03de-4f3b-81fe-bbfdf93bfa6c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.485199 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce4665c7-03de-4f3b-81fe-bbfdf93bfa6c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.486082 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce4665c7-03de-4f3b-81fe-bbfdf93bfa6c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.486387 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce4665c7-03de-4f3b-81fe-bbfdf93bfa6c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.503325 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fa33cc73-5b95-459e-a6f9-cffc7bf477ab tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:37.510979 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fa33cc73-5b95-459e-a6f9-cffc7bf477ab tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1679 microversion: 2.1 time: 0.151144 Jun 07 13:19:37.511547 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 375/746] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:37 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:37.611813 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-ce4665c7-03de-4f3b-81fe-bbfdf93bfa6c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] HTTP exception thrown: Cannot 'detach_volume' instance bfc2b109-2c98-4fdc-b735-5df0ced46167 while it is in vm_state rescued Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ce4665c7-03de-4f3b-81fe-bbfdf93bfa6c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Request method failure captured: Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: DELETE /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-volume_attachments/a4fb002c-f95c-4bd5-bc3c-086a1b2d6d7b HTTP/1.1 Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08fnlwGehPX3-H_Kq_5YwJ5FQsJGwz2frHqKqQ67_UYrSxGEscucac9ZoVlVC7gMud81HUQ5J2_ZlZWeMNcFTo0gNE3uarIqwi2j_-TfEMEZhIE4hhTn76I3Uq5ux-8ZGE780Z7Fsn7Rqn9RqSQPPcytf_qpi5fnis_yDH40YQcQuc Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 562a790e14024341b71d99b5b56fdbfb Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-567307477 Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:19:37.613303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:19:37.614895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_562a790e14024341b71d99b5b56fdbfb", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/562a790e14024341b71d99b5b56fdbfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/562a790e14024341b71d99b5b56fdbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/562a790e14024341b71d99b5b56fdbfb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:19:37.614895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-ServerRescueNegativeTestJSON-567307477 Jun 07 13:19:37.614895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 562a790e14024341b71d99b5b56fdbfb Jun 07 13:19:37.614895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-567307477 Jun 07 13:19:37.614895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-ServerRescueNegativeTestJSON-567307477-project Jun 07 13:19:37.614895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:19:37.614895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:19:37.614895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 3f1820e65ba6475d95f5614a9e035019 Jun 07 13:19:37.614895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-ServerRescueNegativeTestJSON-567307477-project Jun 07 13:19:37.614895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:19:37.614895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Cannot 'detach_volume' instance bfc2b109-2c98-4fdc-b735-5df0ced46167 while it is in vm_state rescued Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'server_id': 'bfc2b109-2c98-4fdc-b735-5df0ced46167', 'id': 'a4fb002c-f95c-4bd5-bc3c-086a1b2d6d7b'} Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bfc2b109-2c98-4fdc-b735-5df0ced46167 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:19:37.618695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:19:37.619890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 07 13:19:37.619890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 13:19:37.619890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 13:19:37.619890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 13:19:37.619890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance bfc2b109-2c98-4fdc-b735-5df0ced46167 while it is in vm_state rescued Jun 07 13:19:37.619890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:37.619890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:37.619890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:37.619890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:37.619890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:37.619890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:37.619890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:19:37.619890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:19:37.619890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance bfc2b109-2c98-4fdc-b735-5df0ced46167 while it is in vm_state rescued Jun 07 13:19:37.619890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:37.619890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ce4665c7-03de-4f3b-81fe-bbfdf93bfa6c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Returning 409 to user: Cannot 'detach_volume' instance bfc2b109-2c98-4fdc-b735-5df0ced46167 while it is in vm_state rescued {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:19:37.620855 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ce4665c7-03de-4f3b-81fe-bbfdf93bfa6c tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-volume_attachments/a4fb002c-f95c-4bd5-bc3c-086a1b2d6d7b" status: 409 len: 152 microversion: 2.1 time: 0.140375 Jun 07 13:19:37.620855 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 372/747] 10.222.0.58 () {58 vars in 1415 bytes} [Tue Jun 7 13:19:37 2022] DELETE /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-volume_attachments/a4fb002c-f95c-4bd5-bc3c-086a1b2d6d7b => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 07 13:19:37.623554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-364112ea-b685-4974-b94d-fcdc3c113294 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:37.624086 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-364112ea-b685-4974-b94d-fcdc3c113294 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:37.630485 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-364112ea-b685-4974-b94d-fcdc3c113294 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.630939 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-364112ea-b685-4974-b94d-fcdc3c113294 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.631696 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-364112ea-b685-4974-b94d-fcdc3c113294 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.632139 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-364112ea-b685-4974-b94d-fcdc3c113294 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.669375 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:37.697788 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-364112ea-b685-4974-b94d-fcdc3c113294 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "POST /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/action" status: 202 len: 0 microversion: 2.1 time: 0.078011 Jun 07 13:19:37.700897 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 376/748] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jun 7 13:19:37 2022] POST /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:19:37.707162 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f716ad22-7c8b-483e-8f09-7051dd238a42 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:37.707776 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f716ad22-7c8b-483e-8f09-7051dd238a42 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:37.714399 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f716ad22-7c8b-483e-8f09-7051dd238a42 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.714878 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f716ad22-7c8b-483e-8f09-7051dd238a42 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.715638 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f716ad22-7c8b-483e-8f09-7051dd238a42 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.716073 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f716ad22-7c8b-483e-8f09-7051dd238a42 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.737895 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e6cb0876-edd3-446c-ac3b-753539267b35 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:37.738532 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e6cb0876-edd3-446c-ac3b-753539267b35 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:37.744619 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e6cb0876-edd3-446c-ac3b-753539267b35 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.745060 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e6cb0876-edd3-446c-ac3b-753539267b35 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.745820 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e6cb0876-edd3-446c-ac3b-753539267b35 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.746246 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e6cb0876-edd3-446c-ac3b-753539267b35 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.768719 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-e6cb0876-edd3-446c-ac3b-753539267b35 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lazy-loading 'flavor' on Instance uuid 25e18880-cb5c-4346-9a43-a861b07f27a8 {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:19:37.843382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e6cb0876-edd3-446c-ac3b-753539267b35 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "POST /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8/action" status: 202 len: 0 microversion: 2.1 time: 0.110080 Jun 07 13:19:37.843970 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 377/749] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jun 7 13:19:37 2022] POST /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 13:19:37.850144 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f716ad22-7c8b-483e-8f09-7051dd238a42 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:37.852190 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-91940735-9485-40bf-9a95-fdc964ced4f9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:37.852892 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-91940735-9485-40bf-9a95-fdc964ced4f9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:37.858408 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f716ad22-7c8b-483e-8f09-7051dd238a42 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1724 microversion: 2.1 time: 0.155719 Jun 07 13:19:37.858901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-91940735-9485-40bf-9a95-fdc964ced4f9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.859125 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 373/750] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:37 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:37.859347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-91940735-9485-40bf-9a95-fdc964ced4f9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.860101 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-91940735-9485-40bf-9a95-fdc964ced4f9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.860533 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-91940735-9485-40bf-9a95-fdc964ced4f9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.989461 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-91940735-9485-40bf-9a95-fdc964ced4f9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:37.996916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-91940735-9485-40bf-9a95-fdc964ced4f9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.148629 Jun 07 13:19:37.997481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 378/751] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:37 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:38.529295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-99158a28-c3fc-4572-99ed-e4fbe8b971e7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:38.529895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-99158a28-c3fc-4572-99ed-e4fbe8b971e7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:38.537121 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-99158a28-c3fc-4572-99ed-e4fbe8b971e7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:38.537565 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-99158a28-c3fc-4572-99ed-e4fbe8b971e7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:38.538325 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-99158a28-c3fc-4572-99ed-e4fbe8b971e7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:38.538782 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-99158a28-c3fc-4572-99ed-e4fbe8b971e7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:38.671342 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-99158a28-c3fc-4572-99ed-e4fbe8b971e7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:38.678792 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-99158a28-c3fc-4572-99ed-e4fbe8b971e7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1679 microversion: 2.1 time: 0.153288 Jun 07 13:19:38.679360 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 374/752] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:38 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:38.876526 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1dac91ca-04c0-4a03-ada4-bf16c38ba784 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:38.877120 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1dac91ca-04c0-4a03-ada4-bf16c38ba784 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:38.883991 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1dac91ca-04c0-4a03-ada4-bf16c38ba784 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:38.884437 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1dac91ca-04c0-4a03-ada4-bf16c38ba784 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:38.885191 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1dac91ca-04c0-4a03-ada4-bf16c38ba784 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:38.885622 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1dac91ca-04c0-4a03-ada4-bf16c38ba784 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:39.016242 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0c575db0-a227-4e6c-8ea8-6817afbcce8b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:39.016854 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0c575db0-a227-4e6c-8ea8-6817afbcce8b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:39.023430 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0c575db0-a227-4e6c-8ea8-6817afbcce8b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:39.023888 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0c575db0-a227-4e6c-8ea8-6817afbcce8b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:39.024651 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0c575db0-a227-4e6c-8ea8-6817afbcce8b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:39.025122 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0c575db0-a227-4e6c-8ea8-6817afbcce8b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:39.040711 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1dac91ca-04c0-4a03-ada4-bf16c38ba784 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:39.048574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1dac91ca-04c0-4a03-ada4-bf16c38ba784 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1724 microversion: 2.1 time: 0.175906 Jun 07 13:19:39.049145 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 379/753] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:38 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:39.159534 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0c575db0-a227-4e6c-8ea8-6817afbcce8b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:39.167188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0c575db0-a227-4e6c-8ea8-6817afbcce8b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.154819 Jun 07 13:19:39.168150 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 375/754] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:39 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:39.255724 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8120b134-9038-489e-b94c-b176148f19c0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:39.256222 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8120b134-9038-489e-b94c-b176148f19c0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:39.262148 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8120b134-9038-489e-b94c-b176148f19c0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:39.262642 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8120b134-9038-489e-b94c-b176148f19c0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:39.263408 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8120b134-9038-489e-b94c-b176148f19c0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:39.263848 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8120b134-9038-489e-b94c-b176148f19c0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:39.386370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-8120b134-9038-489e-b94c-b176148f19c0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lazy-loading 'services' on Instance uuid dec72c48-4900-4d75-8fca-c5b6f5a287ca {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:19:39.499443 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8120b134-9038-489e-b94c-b176148f19c0 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/os-volume_attachments/bc3dba68-3142-4cb2-8d65-7d66f8e67d5a" status: 202 len: 0 microversion: 2.1 time: 0.346317 Jun 07 13:19:39.500055 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 380/755] 10.222.0.58 () {58 vars in 1415 bytes} [Tue Jun 7 13:19:39 2022] DELETE /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/os-volume_attachments/bc3dba68-3142-4cb2-8d65-7d66f8e67d5a => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:19:39.697410 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f0502802-f7bf-47f3-adec-70bcfd82c7c5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:39.698198 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f0502802-f7bf-47f3-adec-70bcfd82c7c5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:39.701164 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=46 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:39.707224 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f0502802-f7bf-47f3-adec-70bcfd82c7c5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:39.707774 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f0502802-f7bf-47f3-adec-70bcfd82c7c5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:39.708624 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f0502802-f7bf-47f3-adec-70bcfd82c7c5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:39.709132 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f0502802-f7bf-47f3-adec-70bcfd82c7c5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:39.847296 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f0502802-f7bf-47f3-adec-70bcfd82c7c5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:39.854767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f0502802-f7bf-47f3-adec-70bcfd82c7c5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1679 microversion: 2.1 time: 0.161279 Jun 07 13:19:39.855341 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 376/756] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:39 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:40.065560 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-36de9ad3-4728-4edc-b343-8f115c2fd04e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:40.066214 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-36de9ad3-4728-4edc-b343-8f115c2fd04e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:40.074123 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-36de9ad3-4728-4edc-b343-8f115c2fd04e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:40.074617 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-36de9ad3-4728-4edc-b343-8f115c2fd04e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:40.075501 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-36de9ad3-4728-4edc-b343-8f115c2fd04e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:40.075931 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-36de9ad3-4728-4edc-b343-8f115c2fd04e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:40.184999 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d433a0e9-46ce-4ddd-90a2-e8314cbe4da0 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:40.185730 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d433a0e9-46ce-4ddd-90a2-e8314cbe4da0 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:40.191680 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d433a0e9-46ce-4ddd-90a2-e8314cbe4da0 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:40.192197 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d433a0e9-46ce-4ddd-90a2-e8314cbe4da0 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:40.193044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d433a0e9-46ce-4ddd-90a2-e8314cbe4da0 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:40.193541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d433a0e9-46ce-4ddd-90a2-e8314cbe4da0 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:40.307078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-36de9ad3-4728-4edc-b343-8f115c2fd04e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:40.318936 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-36de9ad3-4728-4edc-b343-8f115c2fd04e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1724 microversion: 2.1 time: 0.255329 Jun 07 13:19:40.319719 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 381/757] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:40 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:40.337556 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d433a0e9-46ce-4ddd-90a2-e8314cbe4da0 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:40.345471 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d433a0e9-46ce-4ddd-90a2-e8314cbe4da0 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.164388 Jun 07 13:19:40.346045 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 377/758] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:40 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:40.873704 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-93d2833e-d420-47df-be9d-aa4c6f43bee5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:40.874408 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-93d2833e-d420-47df-be9d-aa4c6f43bee5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:40.882149 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-93d2833e-d420-47df-be9d-aa4c6f43bee5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:40.882697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-93d2833e-d420-47df-be9d-aa4c6f43bee5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:40.883455 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-93d2833e-d420-47df-be9d-aa4c6f43bee5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:40.883892 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-93d2833e-d420-47df-be9d-aa4c6f43bee5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.110024 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-93d2833e-d420-47df-be9d-aa4c6f43bee5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:41.118618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-93d2833e-d420-47df-be9d-aa4c6f43bee5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1679 microversion: 2.1 time: 0.248526 Jun 07 13:19:41.119836 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 382/759] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:40 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1679 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:41.336514 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8254cb65-ba64-4c67-917f-154713dd8f3b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:41.337861 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8254cb65-ba64-4c67-917f-154713dd8f3b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:41.356216 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8254cb65-ba64-4c67-917f-154713dd8f3b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.359044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8254cb65-ba64-4c67-917f-154713dd8f3b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.360044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8254cb65-ba64-4c67-917f-154713dd8f3b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.361131 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8254cb65-ba64-4c67-917f-154713dd8f3b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.423275 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-699076f5-ba3e-42d1-ae38-1863010b5ec0 req-bfb609ec-c05d-4e6f-ae63-e1e1e59a4281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5728ed-f056-462a-952e-ce2c4fd06b96", "name": "network-vif-deleted", "tag": "03e4ee37-b76d-476a-8b2a-6aca0431452d"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:41.437668 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-699076f5-ba3e-42d1-ae38-1863010b5ec0 req-bfb609ec-c05d-4e6f-ae63-e1e1e59a4281 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.438201 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-699076f5-ba3e-42d1-ae38-1863010b5ec0 req-bfb609ec-c05d-4e6f-ae63-e1e1e59a4281 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.452598 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-699076f5-ba3e-42d1-ae38-1863010b5ec0 req-bfb609ec-c05d-4e6f-ae63-e1e1e59a4281 service nova] Creating event network-vif-deleted:03e4ee37-b76d-476a-8b2a-6aca0431452d for instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 on hv-cinder-84496 Jun 07 13:19:41.458995 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-699076f5-ba3e-42d1-ae38-1863010b5ec0 req-bfb609ec-c05d-4e6f-ae63-e1e1e59a4281 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110990 Jun 07 13:19:41.460153 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 383/760] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:41.466114 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-dba10b5e-d56e-42b0-839d-aaa3876637e9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:41.467028 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-dba10b5e-d56e-42b0-839d-aaa3876637e9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:41.474051 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dba10b5e-d56e-42b0-839d-aaa3876637e9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.474725 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dba10b5e-d56e-42b0-839d-aaa3876637e9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.475736 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dba10b5e-d56e-42b0-839d-aaa3876637e9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.476172 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dba10b5e-d56e-42b0-839d-aaa3876637e9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.523007 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8254cb65-ba64-4c67-917f-154713dd8f3b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:41.531851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8254cb65-ba64-4c67-917f-154713dd8f3b tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1724 microversion: 2.1 time: 0.199621 Jun 07 13:19:41.532409 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 378/761] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:41 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:41.638873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-dba10b5e-d56e-42b0-839d-aaa3876637e9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:41.647299 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-dba10b5e-d56e-42b0-839d-aaa3876637e9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.185749 Jun 07 13:19:41.648040 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 384/762] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:41 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:41.667447 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-928154b3-d18b-48f9-a0f2-e102f0d5a8f9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:41.673562 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-928154b3-d18b-48f9-a0f2-e102f0d5a8f9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.674187 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-928154b3-d18b-48f9-a0f2-e102f0d5a8f9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.696630 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-928154b3-d18b-48f9-a0f2-e102f0d5a8f9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Going to try to stop instance {{(pid=117797) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 13:19:41.742695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-928154b3-d18b-48f9-a0f2-e102f0d5a8f9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "POST /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/action" status: 202 len: 0 microversion: 2.1 time: 0.079399 Jun 07 13:19:41.746430 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 379/763] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jun 7 13:19:41 2022] POST /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:19:41.751443 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-15d7ac57-518f-4b59-be4b-299258d006ea tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:41.752201 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-15d7ac57-518f-4b59-be4b-299258d006ea tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:41.760590 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15d7ac57-518f-4b59-be4b-299258d006ea tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.761222 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15d7ac57-518f-4b59-be4b-299258d006ea tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.762086 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15d7ac57-518f-4b59-be4b-299258d006ea tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.762566 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15d7ac57-518f-4b59-be4b-299258d006ea tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.898402 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-15d7ac57-518f-4b59-be4b-299258d006ea tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:41.909766 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-15d7ac57-518f-4b59-be4b-299258d006ea tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1679 microversion: 2.1 time: 0.161644 Jun 07 13:19:41.910806 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 385/764] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:41 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:42.138259 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ccdcfe72-c7ad-4fff-9efb-55b37bab4d8b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:42.139263 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ccdcfe72-c7ad-4fff-9efb-55b37bab4d8b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:42.146665 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ccdcfe72-c7ad-4fff-9efb-55b37bab4d8b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:42.147049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ccdcfe72-c7ad-4fff-9efb-55b37bab4d8b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:42.147827 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ccdcfe72-c7ad-4fff-9efb-55b37bab4d8b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:42.148265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ccdcfe72-c7ad-4fff-9efb-55b37bab4d8b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:42.215118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ccdcfe72-c7ad-4fff-9efb-55b37bab4d8b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:42.223420 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ccdcfe72-c7ad-4fff-9efb-55b37bab4d8b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1611 microversion: 2.1 time: 0.090745 Jun 07 13:19:42.224030 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 380/765] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:42 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1611 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:42.549948 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-53e48d64-ac8b-4681-9dac-b9cde8ee4a84 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:42.550687 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-53e48d64-ac8b-4681-9dac-b9cde8ee4a84 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:42.557331 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53e48d64-ac8b-4681-9dac-b9cde8ee4a84 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:42.557868 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53e48d64-ac8b-4681-9dac-b9cde8ee4a84 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:42.558735 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53e48d64-ac8b-4681-9dac-b9cde8ee4a84 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:42.559240 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53e48d64-ac8b-4681-9dac-b9cde8ee4a84 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:42.665777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9fa8355a-8430-4e5a-9de3-b69c37ba0f48 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:42.666575 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9fa8355a-8430-4e5a-9de3-b69c37ba0f48 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:42.673083 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9fa8355a-8430-4e5a-9de3-b69c37ba0f48 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:42.673647 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9fa8355a-8430-4e5a-9de3-b69c37ba0f48 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:42.675204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9fa8355a-8430-4e5a-9de3-b69c37ba0f48 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:42.675744 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9fa8355a-8430-4e5a-9de3-b69c37ba0f48 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:42.688862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-53e48d64-ac8b-4681-9dac-b9cde8ee4a84 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:42.696892 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-53e48d64-ac8b-4681-9dac-b9cde8ee4a84 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1724 microversion: 2.1 time: 0.151636 Jun 07 13:19:42.697723 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 386/766] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:42 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:42.808053 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9fa8355a-8430-4e5a-9de3-b69c37ba0f48 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:42.815683 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9fa8355a-8430-4e5a-9de3-b69c37ba0f48 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.154744 Jun 07 13:19:42.816249 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 381/767] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:42 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:42.928104 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-84e86a71-8d93-46d2-b2e9-a0b8b8d2a16c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:42.928716 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-84e86a71-8d93-46d2-b2e9-a0b8b8d2a16c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:42.940793 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84e86a71-8d93-46d2-b2e9-a0b8b8d2a16c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:42.941607 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84e86a71-8d93-46d2-b2e9-a0b8b8d2a16c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:42.943061 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84e86a71-8d93-46d2-b2e9-a0b8b8d2a16c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:42.943522 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84e86a71-8d93-46d2-b2e9-a0b8b8d2a16c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:43.073617 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-84e86a71-8d93-46d2-b2e9-a0b8b8d2a16c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:43.081659 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-84e86a71-8d93-46d2-b2e9-a0b8b8d2a16c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1679 microversion: 2.1 time: 0.158400 Jun 07 13:19:43.082231 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 387/768] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:42 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:43.240223 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f78f679b-24e4-4b00-9e2c-f5d22b72858b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:43.241009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f78f679b-24e4-4b00-9e2c-f5d22b72858b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:43.247173 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f78f679b-24e4-4b00-9e2c-f5d22b72858b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:43.247652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f78f679b-24e4-4b00-9e2c-f5d22b72858b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:43.248599 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f78f679b-24e4-4b00-9e2c-f5d22b72858b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:43.249029 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f78f679b-24e4-4b00-9e2c-f5d22b72858b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:43.321852 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f78f679b-24e4-4b00-9e2c-f5d22b72858b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:43.329347 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f78f679b-24e4-4b00-9e2c-f5d22b72858b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1611 microversion: 2.1 time: 0.093149 Jun 07 13:19:43.329902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 382/769] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:43 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1611 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:43.713709 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a60b46d6-623e-4302-b1cb-cb903a901286 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:43.714328 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a60b46d6-623e-4302-b1cb-cb903a901286 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:43.720616 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a60b46d6-623e-4302-b1cb-cb903a901286 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:43.721069 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a60b46d6-623e-4302-b1cb-cb903a901286 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:43.721899 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a60b46d6-623e-4302-b1cb-cb903a901286 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:43.722394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a60b46d6-623e-4302-b1cb-cb903a901286 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:43.833323 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-faeab50d-45aa-4063-ac1b-fcdc6620e2c5 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:43.838004 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-faeab50d-45aa-4063-ac1b-fcdc6620e2c5 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:43.853223 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-faeab50d-45aa-4063-ac1b-fcdc6620e2c5 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:43.854091 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-faeab50d-45aa-4063-ac1b-fcdc6620e2c5 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:43.855159 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-faeab50d-45aa-4063-ac1b-fcdc6620e2c5 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:43.856091 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-faeab50d-45aa-4063-ac1b-fcdc6620e2c5 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:44.003619 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-faeab50d-45aa-4063-ac1b-fcdc6620e2c5 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:44.011127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-faeab50d-45aa-4063-ac1b-fcdc6620e2c5 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.182185 Jun 07 13:19:44.011695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 383/770] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:43 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:44.017537 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a60b46d6-623e-4302-b1cb-cb903a901286 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:44.025540 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a60b46d6-623e-4302-b1cb-cb903a901286 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1724 microversion: 2.1 time: 0.315703 Jun 07 13:19:44.026083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 388/771] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:43 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1724 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:44.098744 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f8fdd5bb-d9ef-48dc-b18d-3ffa1417e445 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:44.099372 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f8fdd5bb-d9ef-48dc-b18d-3ffa1417e445 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:44.105463 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f8fdd5bb-d9ef-48dc-b18d-3ffa1417e445 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:44.105911 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f8fdd5bb-d9ef-48dc-b18d-3ffa1417e445 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:44.106731 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f8fdd5bb-d9ef-48dc-b18d-3ffa1417e445 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:44.107164 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f8fdd5bb-d9ef-48dc-b18d-3ffa1417e445 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:44.233483 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f8fdd5bb-d9ef-48dc-b18d-3ffa1417e445 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:44.241602 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f8fdd5bb-d9ef-48dc-b18d-3ffa1417e445 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1679 microversion: 2.1 time: 0.147122 Jun 07 13:19:44.242162 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 384/772] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:44 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:44.347760 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4d021d97-3081-418e-94ee-c54cf51ad318 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:44.348367 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4d021d97-3081-418e-94ee-c54cf51ad318 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:44.354881 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4d021d97-3081-418e-94ee-c54cf51ad318 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:44.355332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4d021d97-3081-418e-94ee-c54cf51ad318 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:44.356101 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4d021d97-3081-418e-94ee-c54cf51ad318 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:44.356532 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4d021d97-3081-418e-94ee-c54cf51ad318 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:44.391965 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4d021d97-3081-418e-94ee-c54cf51ad318 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:44.392624 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4d021d97-3081-418e-94ee-c54cf51ad318 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:44.393090 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-4d021d97-3081-418e-94ee-c54cf51ad318 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lazy-loading 'fault' on Instance uuid 4a5728ed-f056-462a-952e-ce2c4fd06b96 {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:19:44.437621 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4d021d97-3081-418e-94ee-c54cf51ad318 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:44.445338 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4d021d97-3081-418e-94ee-c54cf51ad318 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 200 len: 1330 microversion: 2.1 time: 0.101866 Jun 07 13:19:44.445907 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 389/773] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:44 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:45.028312 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1475fef5-7a39-46b2-a6ce-602034bbc7ef tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:45.028844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1475fef5-7a39-46b2-a6ce-602034bbc7ef tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:45.035720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1475fef5-7a39-46b2-a6ce-602034bbc7ef tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.036165 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1475fef5-7a39-46b2-a6ce-602034bbc7ef tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.036965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1475fef5-7a39-46b2-a6ce-602034bbc7ef tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.037441 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1475fef5-7a39-46b2-a6ce-602034bbc7ef tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.042476 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:45.042644 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e42f37ed-871a-4541-9192-de8dc2cb8b80 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:45.043245 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e42f37ed-871a-4541-9192-de8dc2cb8b80 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:45.050719 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e42f37ed-871a-4541-9192-de8dc2cb8b80 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.051157 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e42f37ed-871a-4541-9192-de8dc2cb8b80 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.051914 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e42f37ed-871a-4541-9192-de8dc2cb8b80 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.052345 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e42f37ed-871a-4541-9192-de8dc2cb8b80 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.068378 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:45.193746 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e42f37ed-871a-4541-9192-de8dc2cb8b80 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:45.193973 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1475fef5-7a39-46b2-a6ce-602034bbc7ef tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:45.201947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1475fef5-7a39-46b2-a6ce-602034bbc7ef tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.177537 Jun 07 13:19:45.202530 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 385/774] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:45 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:45.202915 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e42f37ed-871a-4541-9192-de8dc2cb8b80 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1730 microversion: 2.1 time: 0.164052 Jun 07 13:19:45.210544 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 390/775] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:45 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:45.219687 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-052622cf-558d-468e-b462-bf0d3719434a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:45.220178 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-052622cf-558d-468e-b462-bf0d3719434a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:45.227487 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-052622cf-558d-468e-b462-bf0d3719434a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.227943 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-052622cf-558d-468e-b462-bf0d3719434a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.228713 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-052622cf-558d-468e-b462-bf0d3719434a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.229149 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-052622cf-558d-468e-b462-bf0d3719434a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.266125 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d5dd3d88-ef58-4262-af39-0a0251a7df8e tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:45.266865 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d5dd3d88-ef58-4262-af39-0a0251a7df8e tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:45.273300 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d5dd3d88-ef58-4262-af39-0a0251a7df8e tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.274107 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d5dd3d88-ef58-4262-af39-0a0251a7df8e tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.275643 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d5dd3d88-ef58-4262-af39-0a0251a7df8e tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.276282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d5dd3d88-ef58-4262-af39-0a0251a7df8e tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.317853 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-052622cf-558d-468e-b462-bf0d3719434a tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102293 Jun 07 13:19:45.318474 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 386/776] 10.222.0.58 () {58 vars in 1274 bytes} [Tue Jun 7 13:19:45 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:19:45.418888 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d5dd3d88-ef58-4262-af39-0a0251a7df8e tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:45.427230 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d5dd3d88-ef58-4262-af39-0a0251a7df8e tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1679 microversion: 2.1 time: 0.171667 Jun 07 13:19:45.427808 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 391/777] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:45 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:45.463710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-05b11cee-6df5-40f4-9527-32d263417b15 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:45.464326 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-05b11cee-6df5-40f4-9527-32d263417b15 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:45.470385 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-05b11cee-6df5-40f4-9527-32d263417b15 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.470904 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-05b11cee-6df5-40f4-9527-32d263417b15 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.471716 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-05b11cee-6df5-40f4-9527-32d263417b15 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.472151 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-05b11cee-6df5-40f4-9527-32d263417b15 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.485422 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-05b11cee-6df5-40f4-9527-32d263417b15 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] HTTP exception thrown: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-05b11cee-6df5-40f4-9527-32d263417b15 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Request method failure captured: Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 HTTP/1.1 Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08U-o1RXkpPvRpL7xDzNFmHnSj255NFDhEpduNc0925DPg27io8CB6KRvQZuxcGtY7Iz0iEoMVidEoHUACL1lIGmUyRUR_8aMLzRLJXAMtSSy6JOQkiG83CLgwqXPfpWRfIbnqNAok3xO_9QFcJIn-p7dfSyPkb5TLmEFYuzTkAq94 Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:19:45.487849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:19:45.489427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd6f908209c418490bccdbdef7691a5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:19:45.489427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:19:45.489427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:19:45.489427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:19:45.489427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:19:45.489427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:19:45.489427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:19:45.489427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 3f1a9bfb57f64b85b635c29090aa498c Jun 07 13:19:45.489427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:19:45.489427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:19:45.489427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. Jun 07 13:19:45.489427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': '4a5728ed-f056-462a-952e-ce2c4fd06b96'} Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:19:45.490214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. Jun 07 13:19:45.491643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:45.492977 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-05b11cee-6df5-40f4-9527-32d263417b15 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Returning 404 to user: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:19:45.492977 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-05b11cee-6df5-40f4-9527-32d263417b15 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 404 len: 111 microversion: 2.1 time: 0.029571 Jun 07 13:19:45.492977 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 387/778] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:45 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:19:45.498023 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ce5011aa-e69b-4d0e-81dd-14c5c6a1c6d1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '.version_select at 0x7fb8f90e7e50>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:45.517453 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ce5011aa-e69b-4d0e-81dd-14c5c6a1c6d1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-429549322" status: 202 len: 0 microversion: 2.1 time: 0.023142 Jun 07 13:19:45.518051 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 392/779] 10.222.0.58 () {58 vars in 1217 bytes} [Tue Jun 7 13:19:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-429549322 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:19:46.199268 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5f740991-16bb-4d8a-b62a-beba4b248330 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:46.199876 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5f740991-16bb-4d8a-b62a-beba4b248330 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:46.208048 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5f740991-16bb-4d8a-b62a-beba4b248330 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.208509 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5f740991-16bb-4d8a-b62a-beba4b248330 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.214827 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5f740991-16bb-4d8a-b62a-beba4b248330 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.215293 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5f740991-16bb-4d8a-b62a-beba4b248330 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.261699 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-7b35556a-05de-4fe8-809b-905cd590834e req-8a9cdd17-0ad2-4e1b-ae99-66cf25248a48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc2b109-2c98-4fdc-b735-5df0ced46167", "tag": "3566a568-9f54-445c-8198-4bb46048ae8a"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:46.271182 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-7b35556a-05de-4fe8-809b-905cd590834e req-8a9cdd17-0ad2-4e1b-ae99-66cf25248a48 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.271622 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-7b35556a-05de-4fe8-809b-905cd590834e req-8a9cdd17-0ad2-4e1b-ae99-66cf25248a48 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.282532 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-7b35556a-05de-4fe8-809b-905cd590834e req-8a9cdd17-0ad2-4e1b-ae99-66cf25248a48 service nova] Creating event network-changed:3566a568-9f54-445c-8198-4bb46048ae8a for instance bfc2b109-2c98-4fdc-b735-5df0ced46167 on hv-cinder-84496 Jun 07 13:19:46.288612 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-7b35556a-05de-4fe8-809b-905cd590834e req-8a9cdd17-0ad2-4e1b-ae99-66cf25248a48 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092408 Jun 07 13:19:46.289513 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 393/780] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:19:46.296721 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b46db304-701d-4be3-911c-acfc45c002d8 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:46.297492 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b46db304-701d-4be3-911c-acfc45c002d8 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:46.304210 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b46db304-701d-4be3-911c-acfc45c002d8 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.304659 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b46db304-701d-4be3-911c-acfc45c002d8 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.305436 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b46db304-701d-4be3-911c-acfc45c002d8 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.305933 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b46db304-701d-4be3-911c-acfc45c002d8 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.309035 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-5f740991-16bb-4d8a-b62a-beba4b248330 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lazy-loading 'services' on Instance uuid f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:19:46.441402 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5f740991-16bb-4d8a-b62a-beba4b248330 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0/os-volume_attachments/464914cf-2981-4b30-9de2-05ac3d8fe8c9" status: 202 len: 0 microversion: 2.1 time: 0.245696 Jun 07 13:19:46.442243 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 388/781] 10.222.0.58 () {58 vars in 1415 bytes} [Tue Jun 7 13:19:46 2022] DELETE /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0/os-volume_attachments/464914cf-2981-4b30-9de2-05ac3d8fe8c9 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:19:46.448760 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-37921d7d-29bc-42d0-8c57-aef42407725d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:46.449726 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-37921d7d-29bc-42d0-8c57-aef42407725d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:46.457799 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-37921d7d-29bc-42d0-8c57-aef42407725d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.458258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-37921d7d-29bc-42d0-8c57-aef42407725d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.459059 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-37921d7d-29bc-42d0-8c57-aef42407725d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.459751 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-37921d7d-29bc-42d0-8c57-aef42407725d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.570388 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b46db304-701d-4be3-911c-acfc45c002d8 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:46.587358 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b46db304-701d-4be3-911c-acfc45c002d8 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.296659 Jun 07 13:19:46.589514 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 394/782] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:46 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:46.593780 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d31c92bf-503f-46bb-95bf-b0444dcf6ed7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:46.595375 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d31c92bf-503f-46bb-95bf-b0444dcf6ed7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:46.602213 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d31c92bf-503f-46bb-95bf-b0444dcf6ed7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.602885 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d31c92bf-503f-46bb-95bf-b0444dcf6ed7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.603849 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d31c92bf-503f-46bb-95bf-b0444dcf6ed7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.604450 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d31c92bf-503f-46bb-95bf-b0444dcf6ed7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.640109 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d31c92bf-503f-46bb-95bf-b0444dcf6ed7 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050682 Jun 07 13:19:46.640783 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 395/783] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:19:46 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:46.651028 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-37921d7d-29bc-42d0-8c57-aef42407725d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:46.659727 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-37921d7d-29bc-42d0-8c57-aef42407725d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1679 microversion: 2.1 time: 0.216088 Jun 07 13:19:46.660455 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 389/784] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:46 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1679 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:47.604516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d770b5d6-c365-48be-aa52-93688d0203f8 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:47.605278 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d770b5d6-c365-48be-aa52-93688d0203f8 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:47.611973 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d770b5d6-c365-48be-aa52-93688d0203f8 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.612744 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d770b5d6-c365-48be-aa52-93688d0203f8 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.614073 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d770b5d6-c365-48be-aa52-93688d0203f8 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.614675 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d770b5d6-c365-48be-aa52-93688d0203f8 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.652845 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-05ef1156-987e-40d0-a0fe-75e652c43e82 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:47.653996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-05ef1156-987e-40d0-a0fe-75e652c43e82 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:47.665908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-05ef1156-987e-40d0-a0fe-75e652c43e82 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.667396 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-05ef1156-987e-40d0-a0fe-75e652c43e82 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.668748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-05ef1156-987e-40d0-a0fe-75e652c43e82 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.669354 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-05ef1156-987e-40d0-a0fe-75e652c43e82 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.702959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-05ef1156-987e-40d0-a0fe-75e652c43e82 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054157 Jun 07 13:19:47.709327 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 390/785] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:19:47 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 13:19:47.714464 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b65dd5f9-9aad-4ab1-a44b-0c5c893e0e00 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:47.715084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b65dd5f9-9aad-4ab1-a44b-0c5c893e0e00 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:47.722027 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b65dd5f9-9aad-4ab1-a44b-0c5c893e0e00 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.722714 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b65dd5f9-9aad-4ab1-a44b-0c5c893e0e00 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.723749 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b65dd5f9-9aad-4ab1-a44b-0c5c893e0e00 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.724392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b65dd5f9-9aad-4ab1-a44b-0c5c893e0e00 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.768434 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d770b5d6-c365-48be-aa52-93688d0203f8 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:47.776251 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d770b5d6-c365-48be-aa52-93688d0203f8 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.175620 Jun 07 13:19:47.776827 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 396/786] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:47 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:47.781494 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5366e589-bd12-4d2f-86ba-be630bf0c38e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:47.781993 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5366e589-bd12-4d2f-86ba-be630bf0c38e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:47.788417 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5366e589-bd12-4d2f-86ba-be630bf0c38e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.788867 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5366e589-bd12-4d2f-86ba-be630bf0c38e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.789638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5366e589-bd12-4d2f-86ba-be630bf0c38e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.790079 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5366e589-bd12-4d2f-86ba-be630bf0c38e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.815447 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5366e589-bd12-4d2f-86ba-be630bf0c38e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:19:47.865598 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b65dd5f9-9aad-4ab1-a44b-0c5c893e0e00 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:47.873430 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b65dd5f9-9aad-4ab1-a44b-0c5c893e0e00 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1679 microversion: 2.1 time: 0.163098 Jun 07 13:19:47.873989 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 391/787] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:47 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:47.892105 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5366e589-bd12-4d2f-86ba-be630bf0c38e tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 204 len: 0 microversion: 2.1 time: 0.114061 Jun 07 13:19:47.892684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 397/788] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:19:47 2022] DELETE /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:19:47.901836 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ad63b590-92e1-4cd4-bbe7-e22d441fd295 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:47.902500 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ad63b590-92e1-4cd4-bbe7-e22d441fd295 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:47.908689 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ad63b590-92e1-4cd4-bbe7-e22d441fd295 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.909138 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ad63b590-92e1-4cd4-bbe7-e22d441fd295 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.909893 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ad63b590-92e1-4cd4-bbe7-e22d441fd295 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.910329 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ad63b590-92e1-4cd4-bbe7-e22d441fd295 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:48.037746 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ad63b590-92e1-4cd4-bbe7-e22d441fd295 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:48.045140 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ad63b590-92e1-4cd4-bbe7-e22d441fd295 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1679 microversion: 2.1 time: 0.147115 Jun 07 13:19:48.045701 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 392/789] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:47 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:48.304144 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-f812c5d2-5096-4a73-b891-03d23a665a5f req-9816741f-ed5a-40e6-9353-55d257678c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc2b109-2c98-4fdc-b735-5df0ced46167", "tag": "3566a568-9f54-445c-8198-4bb46048ae8a"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:48.312117 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-f812c5d2-5096-4a73-b891-03d23a665a5f req-9816741f-ed5a-40e6-9353-55d257678c24 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:48.312564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-f812c5d2-5096-4a73-b891-03d23a665a5f req-9816741f-ed5a-40e6-9353-55d257678c24 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:48.323826 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-f812c5d2-5096-4a73-b891-03d23a665a5f req-9816741f-ed5a-40e6-9353-55d257678c24 service nova] Creating event network-changed:3566a568-9f54-445c-8198-4bb46048ae8a for instance bfc2b109-2c98-4fdc-b735-5df0ced46167 on hv-cinder-84496 Jun 07 13:19:48.328560 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-f812c5d2-5096-4a73-b891-03d23a665a5f req-9816741f-ed5a-40e6-9353-55d257678c24 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029003 Jun 07 13:19:48.329112 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 398/790] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:48.794110 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f328c61f-bb53-4085-bc46-9de240c12b47 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:48.795031 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f328c61f-bb53-4085-bc46-9de240c12b47 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:48.802056 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f328c61f-bb53-4085-bc46-9de240c12b47 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:48.802592 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f328c61f-bb53-4085-bc46-9de240c12b47 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:48.803416 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f328c61f-bb53-4085-bc46-9de240c12b47 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:48.803853 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f328c61f-bb53-4085-bc46-9de240c12b47 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:48.892186 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b950289a-4e9b-4c0c-8b32-edc94665b12d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:48.892851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b950289a-4e9b-4c0c-8b32-edc94665b12d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:48.899368 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b950289a-4e9b-4c0c-8b32-edc94665b12d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:48.899824 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b950289a-4e9b-4c0c-8b32-edc94665b12d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:48.900614 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b950289a-4e9b-4c0c-8b32-edc94665b12d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:48.901053 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b950289a-4e9b-4c0c-8b32-edc94665b12d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:49.062482 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b950289a-4e9b-4c0c-8b32-edc94665b12d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:49.070123 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b950289a-4e9b-4c0c-8b32-edc94665b12d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1679 microversion: 2.1 time: 0.182842 Jun 07 13:19:49.070731 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 399/791] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:48 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:49.075364 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6547aac0-31b9-45d9-b195-fe2347d54175 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:49.076139 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6547aac0-31b9-45d9-b195-fe2347d54175 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:49.082377 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6547aac0-31b9-45d9-b195-fe2347d54175 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:49.082859 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6547aac0-31b9-45d9-b195-fe2347d54175 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:49.083629 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6547aac0-31b9-45d9-b195-fe2347d54175 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:49.084071 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6547aac0-31b9-45d9-b195-fe2347d54175 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:49.105867 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f328c61f-bb53-4085-bc46-9de240c12b47 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:49.113416 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f328c61f-bb53-4085-bc46-9de240c12b47 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.323092 Jun 07 13:19:49.114852 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 393/792] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:48 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:49.209789 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6547aac0-31b9-45d9-b195-fe2347d54175 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:49.217294 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6547aac0-31b9-45d9-b195-fe2347d54175 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1679 microversion: 2.1 time: 0.145546 Jun 07 13:19:49.217855 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 400/793] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:49 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:50.086844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a23d3039-089f-434e-9d25-99cb62fe40cf tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:50.087462 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a23d3039-089f-434e-9d25-99cb62fe40cf tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:50.094267 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a23d3039-089f-434e-9d25-99cb62fe40cf tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.094802 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a23d3039-089f-434e-9d25-99cb62fe40cf tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.095567 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a23d3039-089f-434e-9d25-99cb62fe40cf tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.096493 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a23d3039-089f-434e-9d25-99cb62fe40cf tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.131333 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-933af93b-5ab4-460a-9a13-904daf36c114 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:50.132402 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-933af93b-5ab4-460a-9a13-904daf36c114 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:50.139265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-933af93b-5ab4-460a-9a13-904daf36c114 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.139860 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-933af93b-5ab4-460a-9a13-904daf36c114 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.140722 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-933af93b-5ab4-460a-9a13-904daf36c114 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.141276 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-933af93b-5ab4-460a-9a13-904daf36c114 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.237190 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a23d3039-089f-434e-9d25-99cb62fe40cf tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:50.245020 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a23d3039-089f-434e-9d25-99cb62fe40cf tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1679 microversion: 2.1 time: 0.162371 Jun 07 13:19:50.245801 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 394/794] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:50 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:50.250874 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3c99e51f-477c-4230-a6d1-ed25098b1420 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:50.251485 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3c99e51f-477c-4230-a6d1-ed25098b1420 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:50.257328 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3c99e51f-477c-4230-a6d1-ed25098b1420 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.257781 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3c99e51f-477c-4230-a6d1-ed25098b1420 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.258575 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3c99e51f-477c-4230-a6d1-ed25098b1420 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.259014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3c99e51f-477c-4230-a6d1-ed25098b1420 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.390781 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3c99e51f-477c-4230-a6d1-ed25098b1420 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:50.399962 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3c99e51f-477c-4230-a6d1-ed25098b1420 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 200 len: 1679 microversion: 2.1 time: 0.153311 Jun 07 13:19:50.400617 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 395/795] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:50 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:50.406565 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-933af93b-5ab4-460a-9a13-904daf36c114 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:50.414472 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-933af93b-5ab4-460a-9a13-904daf36c114 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.287043 Jun 07 13:19:50.415106 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 401/796] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:50 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:50.797220 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-d2571e67-fd7b-4786-84e5-236ddedb019c req-949581b9-7f7d-42c2-b9e1-a8401ced1d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0", "name": "network-vif-deleted", "tag": "fa01f4c1-c3a7-4d48-95e4-fa07833fc0cc"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:50.807441 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-d2571e67-fd7b-4786-84e5-236ddedb019c req-949581b9-7f7d-42c2-b9e1-a8401ced1d7e service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.808011 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-d2571e67-fd7b-4786-84e5-236ddedb019c req-949581b9-7f7d-42c2-b9e1-a8401ced1d7e service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.819662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-d2571e67-fd7b-4786-84e5-236ddedb019c req-949581b9-7f7d-42c2-b9e1-a8401ced1d7e service nova] Creating event network-vif-deleted:fa01f4c1-c3a7-4d48-95e4-fa07833fc0cc for instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 on hv-cinder-84496 Jun 07 13:19:50.824915 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-d2571e67-fd7b-4786-84e5-236ddedb019c req-949581b9-7f7d-42c2-b9e1-a8401ced1d7e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031422 Jun 07 13:19:50.828321 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 396/797] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:51.261446 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7e7264bb-4ab9-4cc3-9610-10a1ca553bf7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:51.262008 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7e7264bb-4ab9-4cc3-9610-10a1ca553bf7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:51.268504 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7e7264bb-4ab9-4cc3-9610-10a1ca553bf7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:51.268964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7e7264bb-4ab9-4cc3-9610-10a1ca553bf7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:51.269777 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7e7264bb-4ab9-4cc3-9610-10a1ca553bf7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:51.270244 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7e7264bb-4ab9-4cc3-9610-10a1ca553bf7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:51.418732 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9e55f78f-642b-4f56-bccc-c0c8c215fc2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:51.422917 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7e7264bb-4ab9-4cc3-9610-10a1ca553bf7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:51.427312 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9e55f78f-642b-4f56-bccc-c0c8c215fc2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:51.435642 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7e7264bb-4ab9-4cc3-9610-10a1ca553bf7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1679 microversion: 2.1 time: 0.178355 Jun 07 13:19:51.436228 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 402/798] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:51 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:51.440656 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e55f78f-642b-4f56-bccc-c0c8c215fc2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:51.441114 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e55f78f-642b-4f56-bccc-c0c8c215fc2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:51.441900 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e55f78f-642b-4f56-bccc-c0c8c215fc2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:51.452251 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e55f78f-642b-4f56-bccc-c0c8c215fc2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:51.457295 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c777b620-f172-4937-bd91-f895106e3a3b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:51.458154 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c777b620-f172-4937-bd91-f895106e3a3b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:51.466205 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c777b620-f172-4937-bd91-f895106e3a3b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:51.474465 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c777b620-f172-4937-bd91-f895106e3a3b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:51.475529 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c777b620-f172-4937-bd91-f895106e3a3b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:51.475815 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-9e55f78f-642b-4f56-bccc-c0c8c215fc2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] HTTP exception thrown: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. Jun 07 13:19:51.476327 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c777b620-f172-4937-bd91-f895106e3a3b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9e55f78f-642b-4f56-bccc-c0c8c215fc2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Request method failure captured: Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 HTTP/1.1 Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08U-o1RXkpPvRpL7xDzNFmHnSj255NFDhEpduNc0925DPg27io8CB6KRvQZuxcGtY7Iz0iEoMVidEoHUACL1lIGmUyRUR_8aMLzRLJXAMtSSy6JOQkiG83CLgwqXPfpWRfIbnqNAok3xO_9QFcJIn-p7dfSyPkb5TLmEFYuzTkAq94 Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:19:51.480590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:19:51.481938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd6f908209c418490bccdbdef7691a5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:19:51.481938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:19:51.481938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:19:51.481938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:19:51.481938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:19:51.481938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:19:51.481938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:19:51.481938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 3f1a9bfb57f64b85b635c29090aa498c Jun 07 13:19:51.481938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:19:51.481938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:19:51.481938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. Jun 07 13:19:51.481938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': 'f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0'} Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:19:51.482720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. Jun 07 13:19:51.483957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:19:51.487891 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9e55f78f-642b-4f56-bccc-c0c8c215fc2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Returning 404 to user: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:19:51.487891 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9e55f78f-642b-4f56-bccc-c0c8c215fc2a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 404 len: 111 microversion: 2.1 time: 0.069581 Jun 07 13:19:51.487891 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 397/799] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:51 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:19:51.493296 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f3aa8e64-0acf-46f8-bd65-a7cd7d473ca4 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '.version_select at 0x7fb8f8ef1940>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:51.513536 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f3aa8e64-0acf-46f8-bd65-a7cd7d473ca4 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-596909349" status: 202 len: 0 microversion: 2.1 time: 0.023852 Jun 07 13:19:51.514564 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 398/800] 10.222.0.58 () {58 vars in 1217 bytes} [Tue Jun 7 13:19:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-596909349 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:19:51.779066 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c777b620-f172-4937-bd91-f895106e3a3b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:51.791049 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c777b620-f172-4937-bd91-f895106e3a3b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.347766 Jun 07 13:19:51.802106 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 403/801] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:51 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:52.453557 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1f6fb1a6-e2c2-4f7b-84e5-7cef59b6196f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:52.454175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1f6fb1a6-e2c2-4f7b-84e5-7cef59b6196f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:52.461646 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1f6fb1a6-e2c2-4f7b-84e5-7cef59b6196f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:52.462094 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1f6fb1a6-e2c2-4f7b-84e5-7cef59b6196f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:52.462894 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1f6fb1a6-e2c2-4f7b-84e5-7cef59b6196f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:52.463338 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1f6fb1a6-e2c2-4f7b-84e5-7cef59b6196f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:52.595789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1f6fb1a6-e2c2-4f7b-84e5-7cef59b6196f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:52.605047 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1f6fb1a6-e2c2-4f7b-84e5-7cef59b6196f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1679 microversion: 2.1 time: 0.155821 Jun 07 13:19:52.605704 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 399/802] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:52 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:52.633087 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-48c8001e-a77d-45dd-a204-05449a1cb036 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Action: 'create', calling method: .version_select at 0x7fb8f9015310>, body: {"keypair": {"name": "tempest-keypair-1143139216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6AB8fwQLy2sojPXmvBqmLMxqzHMgpRVEI0+3w+LTD7XSlWjZcPvd8LXh9MJvVPNNn2PCOab16/9dNzasQa/lAaC62+NrI00Ohl0zyjYiOezXfxkQ2TeGgnWBQdv92boA=="}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:52.647869 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-48c8001e-a77d-45dd-a204-05449a1cb036 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Getting quotas for project 3fd6f908209c418490bccdbdef7691a5. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:19:52.651531 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-48c8001e-a77d-45dd-a204-05449a1cb036 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Getting quotas for user 3f1a9bfb57f64b85b635c29090aa498c and project 3fd6f908209c418490bccdbdef7691a5. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:19:52.673024 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-48c8001e-a77d-45dd-a204-05449a1cb036 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043772 Jun 07 13:19:52.673603 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 404/803] 10.222.0.58 () {60 vars in 1158 bytes} [Tue Jun 7 13:19:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:19:52.809402 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1e18e6a1-7769-4fd7-a2f7-7987d763a202 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:52.810026 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1e18e6a1-7769-4fd7-a2f7-7987d763a202 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:52.816613 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1e18e6a1-7769-4fd7-a2f7-7987d763a202 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:52.817060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1e18e6a1-7769-4fd7-a2f7-7987d763a202 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:52.817830 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1e18e6a1-7769-4fd7-a2f7-7987d763a202 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:52.818463 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1e18e6a1-7769-4fd7-a2f7-7987d763a202 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:52.986300 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1e18e6a1-7769-4fd7-a2f7-7987d763a202 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:52.994540 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1e18e6a1-7769-4fd7-a2f7-7987d763a202 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.189070 Jun 07 13:19:52.995206 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 400/804] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:52 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:53.621082 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-314ae175-d202-414a-8b36-12b3c7be0ed2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:53.621879 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-314ae175-d202-414a-8b36-12b3c7be0ed2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:53.627895 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-314ae175-d202-414a-8b36-12b3c7be0ed2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:53.628349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-314ae175-d202-414a-8b36-12b3c7be0ed2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:53.629130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-314ae175-d202-414a-8b36-12b3c7be0ed2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:53.629573 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-314ae175-d202-414a-8b36-12b3c7be0ed2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:53.835875 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-314ae175-d202-414a-8b36-12b3c7be0ed2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:53.843460 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-314ae175-d202-414a-8b36-12b3c7be0ed2 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1679 microversion: 2.1 time: 0.226318 Jun 07 13:19:53.844033 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 405/805] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:53 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1679 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:54.012675 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-690a7164-a624-4c32-a5d0-111b5125bb57 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:54.013870 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-690a7164-a624-4c32-a5d0-111b5125bb57 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:54.026306 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-690a7164-a624-4c32-a5d0-111b5125bb57 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.026802 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-690a7164-a624-4c32-a5d0-111b5125bb57 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:54.027594 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-690a7164-a624-4c32-a5d0-111b5125bb57 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.028039 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-690a7164-a624-4c32-a5d0-111b5125bb57 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:54.081795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-765e7781-c72d-4fb7-83ea-50c0ebebc9c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1958682855", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a83b14f0-daca-457b-9e46-5ac0b9a7ecdf"}], "security_groups": [{"name": "tempest-securitygroup--497976585"}], "key_name": "tempest-keypair-1143139216", "user_data": "}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:54.166140 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-690a7164-a624-4c32-a5d0-111b5125bb57 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:54.174828 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-690a7164-a624-4c32-a5d0-111b5125bb57 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.165347 Jun 07 13:19:54.175454 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 401/806] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:54 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:54.190380 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-765e7781-c72d-4fb7-83ea-50c0ebebc9c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] validate_networks() for [('a83b14f0-daca-457b-9e46-5ac0b9a7ecdf', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:19:54.355502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:54.615092 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-765e7781-c72d-4fb7-83ea-50c0ebebc9c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:19:54.615513 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-765e7781-c72d-4fb7-83ea-50c0ebebc9c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:19:54.615984 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-765e7781-c72d-4fb7-83ea-50c0ebebc9c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:19:54.616393 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-765e7781-c72d-4fb7-83ea-50c0ebebc9c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:19:54.616803 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-765e7781-c72d-4fb7-83ea-50c0ebebc9c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:19:54.625730 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-765e7781-c72d-4fb7-83ea-50c0ebebc9c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.626177 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-765e7781-c72d-4fb7-83ea-50c0ebebc9c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:54.627018 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-765e7781-c72d-4fb7-83ea-50c0ebebc9c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.627452 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-765e7781-c72d-4fb7-83ea-50c0ebebc9c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:54.643905 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-765e7781-c72d-4fb7-83ea-50c0ebebc9c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Getting quotas for project 3fd6f908209c418490bccdbdef7691a5. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:19:54.648275 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-765e7781-c72d-4fb7-83ea-50c0ebebc9c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Getting quotas for user 3f1a9bfb57f64b85b635c29090aa498c and project 3fd6f908209c418490bccdbdef7691a5. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:19:54.659867 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-765e7781-c72d-4fb7-83ea-50c0ebebc9c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:19:54.662142 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-765e7781-c72d-4fb7-83ea-50c0ebebc9c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:19:54.715827 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-765e7781-c72d-4fb7-83ea-50c0ebebc9c0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.639141 Jun 07 13:19:54.716701 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 406/807] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:19:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 13:19:54.726879 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d44b8389-09e9-4b0b-bcf6-ad46f879db67 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:54.727499 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d44b8389-09e9-4b0b-bcf6-ad46f879db67 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:54.780506 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d44b8389-09e9-4b0b-bcf6-ad46f879db67 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:54.787831 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d44b8389-09e9-4b0b-bcf6-ad46f879db67 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1242 microversion: 2.1 time: 0.064726 Jun 07 13:19:54.789431 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 402/808] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:54 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:54.860100 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8249b78c-ed5e-4cff-b8ee-ba3ba52d5b4f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:54.860793 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8249b78c-ed5e-4cff-b8ee-ba3ba52d5b4f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:54.869267 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8249b78c-ed5e-4cff-b8ee-ba3ba52d5b4f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.869869 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8249b78c-ed5e-4cff-b8ee-ba3ba52d5b4f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:54.870763 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8249b78c-ed5e-4cff-b8ee-ba3ba52d5b4f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.871271 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8249b78c-ed5e-4cff-b8ee-ba3ba52d5b4f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:55.097600 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8249b78c-ed5e-4cff-b8ee-ba3ba52d5b4f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:55.106816 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8249b78c-ed5e-4cff-b8ee-ba3ba52d5b4f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1679 microversion: 2.1 time: 0.250700 Jun 07 13:19:55.107492 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 407/809] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:54 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1679 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:55.193579 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-88be704d-c0b3-4447-903a-f795d20926ca tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:55.194535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-88be704d-c0b3-4447-903a-f795d20926ca tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:55.203709 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-88be704d-c0b3-4447-903a-f795d20926ca tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:55.204255 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-88be704d-c0b3-4447-903a-f795d20926ca tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:55.205639 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-88be704d-c0b3-4447-903a-f795d20926ca tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:55.206309 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-88be704d-c0b3-4447-903a-f795d20926ca tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:55.363947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-88be704d-c0b3-4447-903a-f795d20926ca tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:55.371926 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-88be704d-c0b3-4447-903a-f795d20926ca tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.183414 Jun 07 13:19:55.372509 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 403/810] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:55 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:55.806186 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b6020c16-0bd0-4458-b2c2-20e255d64f13 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:55.806749 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b6020c16-0bd0-4458-b2c2-20e255d64f13 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:55.813307 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b6020c16-0bd0-4458-b2c2-20e255d64f13 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:55.813754 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b6020c16-0bd0-4458-b2c2-20e255d64f13 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:55.815169 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b6020c16-0bd0-4458-b2c2-20e255d64f13 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:55.815606 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b6020c16-0bd0-4458-b2c2-20e255d64f13 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:55.876230 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b6020c16-0bd0-4458-b2c2-20e255d64f13 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:55.884667 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b6020c16-0bd0-4458-b2c2-20e255d64f13 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1294 microversion: 2.1 time: 0.082663 Jun 07 13:19:55.885541 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 408/811] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:55 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:56.123550 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-11c4bd00-cbfe-4745-b683-e1b7491a906f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:56.124168 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-11c4bd00-cbfe-4745-b683-e1b7491a906f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:56.130216 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-11c4bd00-cbfe-4745-b683-e1b7491a906f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.130699 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-11c4bd00-cbfe-4745-b683-e1b7491a906f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.131472 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-11c4bd00-cbfe-4745-b683-e1b7491a906f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.131915 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-11c4bd00-cbfe-4745-b683-e1b7491a906f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.260351 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-11c4bd00-cbfe-4745-b683-e1b7491a906f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:56.267772 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-11c4bd00-cbfe-4745-b683-e1b7491a906f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1679 microversion: 2.1 time: 0.148100 Jun 07 13:19:56.268419 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 404/812] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:56 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:56.390081 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2103aa3d-fbf1-4764-8216-0698b146ca96 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:56.390713 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2103aa3d-fbf1-4764-8216-0698b146ca96 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:56.396765 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2103aa3d-fbf1-4764-8216-0698b146ca96 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.397225 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2103aa3d-fbf1-4764-8216-0698b146ca96 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.397996 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2103aa3d-fbf1-4764-8216-0698b146ca96 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.398483 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2103aa3d-fbf1-4764-8216-0698b146ca96 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.414009 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:56.528235 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2103aa3d-fbf1-4764-8216-0698b146ca96 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:56.536450 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2103aa3d-fbf1-4764-8216-0698b146ca96 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.150535 Jun 07 13:19:56.537006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 409/813] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:56 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:56.901695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f1d53f76-dc59-4dc1-b98b-0c64161e16f0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:56.902296 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f1d53f76-dc59-4dc1-b98b-0c64161e16f0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:56.908769 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f1d53f76-dc59-4dc1-b98b-0c64161e16f0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.909133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f1d53f76-dc59-4dc1-b98b-0c64161e16f0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.909944 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f1d53f76-dc59-4dc1-b98b-0c64161e16f0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.910531 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f1d53f76-dc59-4dc1-b98b-0c64161e16f0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.928596 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:56.972405 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f1d53f76-dc59-4dc1-b98b-0c64161e16f0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:56.979671 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f1d53f76-dc59-4dc1-b98b-0c64161e16f0 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1294 microversion: 2.1 time: 0.082005 Jun 07 13:19:56.980225 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 405/814] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:56 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:57.284936 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7de853ca-6742-4114-a378-b1e713d713de tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:57.285548 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7de853ca-6742-4114-a378-b1e713d713de tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:57.292205 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7de853ca-6742-4114-a378-b1e713d713de tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:57.292662 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7de853ca-6742-4114-a378-b1e713d713de tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:57.293428 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7de853ca-6742-4114-a378-b1e713d713de tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:57.293870 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7de853ca-6742-4114-a378-b1e713d713de tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:57.428897 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7de853ca-6742-4114-a378-b1e713d713de tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:57.436377 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7de853ca-6742-4114-a378-b1e713d713de tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1679 microversion: 2.1 time: 0.155333 Jun 07 13:19:57.436946 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 410/815] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:57 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:57.554036 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-39d80493-1563-4e39-92e8-98b28025ad4e tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:57.554639 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-39d80493-1563-4e39-92e8-98b28025ad4e tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:57.561992 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39d80493-1563-4e39-92e8-98b28025ad4e tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:57.563064 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39d80493-1563-4e39-92e8-98b28025ad4e tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:57.564556 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39d80493-1563-4e39-92e8-98b28025ad4e tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:57.565421 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39d80493-1563-4e39-92e8-98b28025ad4e tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:57.714127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-39d80493-1563-4e39-92e8-98b28025ad4e tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:57.722141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-39d80493-1563-4e39-92e8-98b28025ad4e tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.172387 Jun 07 13:19:57.722727 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 406/816] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:57 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:57.997784 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-eebcf5cb-ab92-4e2f-a2bb-39af33222f05 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:57.998742 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-eebcf5cb-ab92-4e2f-a2bb-39af33222f05 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:58.005134 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eebcf5cb-ab92-4e2f-a2bb-39af33222f05 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:58.005874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eebcf5cb-ab92-4e2f-a2bb-39af33222f05 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:58.007004 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eebcf5cb-ab92-4e2f-a2bb-39af33222f05 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:58.007517 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eebcf5cb-ab92-4e2f-a2bb-39af33222f05 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:58.078696 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-eebcf5cb-ab92-4e2f-a2bb-39af33222f05 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:58.087563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-eebcf5cb-ab92-4e2f-a2bb-39af33222f05 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1300 microversion: 2.1 time: 0.094632 Jun 07 13:19:58.088678 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 411/817] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:57 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:58.454723 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-26d6d5a0-1b1b-4928-9112-31e808bb4e51 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:58.455525 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-26d6d5a0-1b1b-4928-9112-31e808bb4e51 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:58.464308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-26d6d5a0-1b1b-4928-9112-31e808bb4e51 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:58.464763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-26d6d5a0-1b1b-4928-9112-31e808bb4e51 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:58.466800 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-26d6d5a0-1b1b-4928-9112-31e808bb4e51 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:58.467428 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-26d6d5a0-1b1b-4928-9112-31e808bb4e51 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:58.603157 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-26d6d5a0-1b1b-4928-9112-31e808bb4e51 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:58.610801 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-26d6d5a0-1b1b-4928-9112-31e808bb4e51 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1679 microversion: 2.1 time: 0.160028 Jun 07 13:19:58.611355 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 407/818] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:58 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:58.739782 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0f15b008-f113-4342-bf57-254e3df4849f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:58.740532 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0f15b008-f113-4342-bf57-254e3df4849f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:58.746978 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0f15b008-f113-4342-bf57-254e3df4849f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:58.747423 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0f15b008-f113-4342-bf57-254e3df4849f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:58.748177 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0f15b008-f113-4342-bf57-254e3df4849f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:58.748608 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0f15b008-f113-4342-bf57-254e3df4849f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:58.979555 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0f15b008-f113-4342-bf57-254e3df4849f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:58.988852 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0f15b008-f113-4342-bf57-254e3df4849f tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1510 microversion: 2.1 time: 0.253457 Jun 07 13:19:58.989423 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 412/819] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:58 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:59.006011 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c14d0835-08d9-4e2e-87eb-ac4c9abf3028 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:59.006717 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c14d0835-08d9-4e2e-87eb-ac4c9abf3028 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:59.013101 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c14d0835-08d9-4e2e-87eb-ac4c9abf3028 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.013633 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c14d0835-08d9-4e2e-87eb-ac4c9abf3028 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.014695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c14d0835-08d9-4e2e-87eb-ac4c9abf3028 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.015205 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c14d0835-08d9-4e2e-87eb-ac4c9abf3028 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.106001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3ec75975-a335-442e-9d26-d7fa05398d9f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:59.106700 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3ec75975-a335-442e-9d26-d7fa05398d9f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:59.113723 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3ec75975-a335-442e-9d26-d7fa05398d9f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.114081 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3ec75975-a335-442e-9d26-d7fa05398d9f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.114953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3ec75975-a335-442e-9d26-d7fa05398d9f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.115840 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3ec75975-a335-442e-9d26-d7fa05398d9f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.163218 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c14d0835-08d9-4e2e-87eb-ac4c9abf3028 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "POST /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8/action" status: 202 len: 0 microversion: 2.1 time: 0.161774 Jun 07 13:19:59.167432 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 408/820] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jun 7 13:19:59 2022] POST /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:19:59.172645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-272d54f3-9a22-48b0-a540-7feed8fce4c0 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:59.172969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-272d54f3-9a22-48b0-a540-7feed8fce4c0 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:59.179860 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-272d54f3-9a22-48b0-a540-7feed8fce4c0 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.180861 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-272d54f3-9a22-48b0-a540-7feed8fce4c0 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.181805 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-272d54f3-9a22-48b0-a540-7feed8fce4c0 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.182384 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-272d54f3-9a22-48b0-a540-7feed8fce4c0 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.340452 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3ec75975-a335-442e-9d26-d7fa05398d9f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:59.350542 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3ec75975-a335-442e-9d26-d7fa05398d9f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1367 microversion: 2.1 time: 0.249206 Jun 07 13:19:59.365512 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 413/821] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:59 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:59.365512 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-0aef71c5-1dad-4767-bf01-07b5fab8e37c req-d7be0f04-cb46-49d4-a19e-1be3d2f8899a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "771de6d7-c5ac-4fe8-9706-dee8ef1564bc", "tag": "a1d422ae-82e2-478f-8ea1-ce6ed50756ea"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:59.370859 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-272d54f3-9a22-48b0-a540-7feed8fce4c0 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:59.377599 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-0aef71c5-1dad-4767-bf01-07b5fab8e37c req-d7be0f04-cb46-49d4-a19e-1be3d2f8899a service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.378046 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-0aef71c5-1dad-4767-bf01-07b5fab8e37c req-d7be0f04-cb46-49d4-a19e-1be3d2f8899a service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.378818 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-272d54f3-9a22-48b0-a540-7feed8fce4c0 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1518 microversion: 2.1 time: 0.210300 Jun 07 13:19:59.379794 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 409/822] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:59 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:59.390409 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-0aef71c5-1dad-4767-bf01-07b5fab8e37c req-d7be0f04-cb46-49d4-a19e-1be3d2f8899a service nova] Creating event network-changed:a1d422ae-82e2-478f-8ea1-ce6ed50756ea for instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc on hv-cinder-84496 Jun 07 13:19:59.396063 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-0aef71c5-1dad-4767-bf01-07b5fab8e37c req-d7be0f04-cb46-49d4-a19e-1be3d2f8899a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038012 Jun 07 13:19:59.396890 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 414/823] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:59.627914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8b16c2f1-4a94-47dd-a22b-2107c288e163 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:59.629221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8b16c2f1-4a94-47dd-a22b-2107c288e163 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:59.637893 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8b16c2f1-4a94-47dd-a22b-2107c288e163 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.638345 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8b16c2f1-4a94-47dd-a22b-2107c288e163 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.639193 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8b16c2f1-4a94-47dd-a22b-2107c288e163 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.639696 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8b16c2f1-4a94-47dd-a22b-2107c288e163 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.784541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8b16c2f1-4a94-47dd-a22b-2107c288e163 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:59.791968 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8b16c2f1-4a94-47dd-a22b-2107c288e163 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1656 microversion: 2.1 time: 0.167984 Jun 07 13:19:59.792551 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 410/824] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:59 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1656 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:59.808691 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a6e977a0-7f90-48e1-ba35-366331599b5e tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:59.814830 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a6e977a0-7f90-48e1-ba35-366331599b5e tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.815799 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a6e977a0-7f90-48e1-ba35-366331599b5e tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.874899 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a6e977a0-7f90-48e1-ba35-366331599b5e tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Going to try to start instance {{(pid=117798) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 13:19:59.915420 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a6e977a0-7f90-48e1-ba35-366331599b5e tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "POST /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/action" status: 202 len: 0 microversion: 2.1 time: 0.111184 Jun 07 13:19:59.916006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 415/825] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jun 7 13:19:59 2022] POST /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:19:59.923958 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3f201768-3d10-4909-acfc-87711b44919f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:59.924607 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3f201768-3d10-4909-acfc-87711b44919f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:59.930547 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3f201768-3d10-4909-acfc-87711b44919f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.930998 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3f201768-3d10-4909-acfc-87711b44919f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.931765 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3f201768-3d10-4909-acfc-87711b44919f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.932201 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3f201768-3d10-4909-acfc-87711b44919f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:00.055097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3f201768-3d10-4909-acfc-87711b44919f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:00.062576 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3f201768-3d10-4909-acfc-87711b44919f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1665 microversion: 2.1 time: 0.142434 Jun 07 13:20:00.063140 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 411/826] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:59 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1665 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:00.373655 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ff086ddd-8456-4b1f-b611-79eb1aaaac16 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:00.374368 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ff086ddd-8456-4b1f-b611-79eb1aaaac16 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:00.380854 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ff086ddd-8456-4b1f-b611-79eb1aaaac16 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:00.381333 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ff086ddd-8456-4b1f-b611-79eb1aaaac16 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:00.382103 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ff086ddd-8456-4b1f-b611-79eb1aaaac16 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:00.382567 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ff086ddd-8456-4b1f-b611-79eb1aaaac16 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:00.395831 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ccf34470-e0d6-4aa0-ac40-dc47caebe3df tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:00.396447 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ccf34470-e0d6-4aa0-ac40-dc47caebe3df tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:00.402537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ccf34470-e0d6-4aa0-ac40-dc47caebe3df tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:00.402992 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ccf34470-e0d6-4aa0-ac40-dc47caebe3df tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:00.403755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ccf34470-e0d6-4aa0-ac40-dc47caebe3df tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:00.404188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ccf34470-e0d6-4aa0-ac40-dc47caebe3df tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:00.511586 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ff086ddd-8456-4b1f-b611-79eb1aaaac16 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:00.519588 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ff086ddd-8456-4b1f-b611-79eb1aaaac16 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1367 microversion: 2.1 time: 0.150136 Jun 07 13:20:00.520193 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 416/827] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:00 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:00.536716 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ccf34470-e0d6-4aa0-ac40-dc47caebe3df tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:00.544469 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ccf34470-e0d6-4aa0-ac40-dc47caebe3df tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1520 microversion: 2.1 time: 0.152962 Jun 07 13:20:00.545251 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 412/828] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:00 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:00.687060 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-d83e2f12-afd8-47b4-87fa-380be8189476 req-82710131-3d2e-494c-9daa-255842dfefa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e18880-cb5c-4346-9a43-a861b07f27a8", "name": "network-vif-unplugged", "status": "completed", "tag": "d0c830a1-4526-4f25-a02e-0ee9838a85ba"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:00.695847 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d83e2f12-afd8-47b4-87fa-380be8189476 req-82710131-3d2e-494c-9daa-255842dfefa4 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:00.696294 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d83e2f12-afd8-47b4-87fa-380be8189476 req-82710131-3d2e-494c-9daa-255842dfefa4 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:00.710115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.compute.server_external_events [req-d83e2f12-afd8-47b4-87fa-380be8189476 req-82710131-3d2e-494c-9daa-255842dfefa4 service nova] Unable to find a host for instance 25e18880-cb5c-4346-9a43-a861b07f27a8. Dropping event network-vif-unplugged {{(pid=117798) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 13:20:00.711049 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-d83e2f12-afd8-47b4-87fa-380be8189476 req-82710131-3d2e-494c-9daa-255842dfefa4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.082140 Jun 07 13:20:00.711640 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 417/829] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 84 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 07 13:20:01.080104 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-010c302c-082b-4b44-a0c2-446cd5ab4b51 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:01.080721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-010c302c-082b-4b44-a0c2-446cd5ab4b51 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:01.087209 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-010c302c-082b-4b44-a0c2-446cd5ab4b51 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.087662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-010c302c-082b-4b44-a0c2-446cd5ab4b51 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.088424 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-010c302c-082b-4b44-a0c2-446cd5ab4b51 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.088865 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-010c302c-082b-4b44-a0c2-446cd5ab4b51 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.213748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-010c302c-082b-4b44-a0c2-446cd5ab4b51 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:01.221316 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-010c302c-082b-4b44-a0c2-446cd5ab4b51 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1665 microversion: 2.1 time: 0.145019 Jun 07 13:20:01.221889 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 413/830] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:01 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1665 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:01.537047 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d893822f-bf0c-4959-a506-682cc0cbdcb4 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:01.537574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d893822f-bf0c-4959-a506-682cc0cbdcb4 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:01.544222 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d893822f-bf0c-4959-a506-682cc0cbdcb4 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.544673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d893822f-bf0c-4959-a506-682cc0cbdcb4 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.545433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d893822f-bf0c-4959-a506-682cc0cbdcb4 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.545873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d893822f-bf0c-4959-a506-682cc0cbdcb4 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.562103 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8906cf9b-c272-453b-bd3e-14163b2f10cb tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:01.562741 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8906cf9b-c272-453b-bd3e-14163b2f10cb tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:01.568801 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8906cf9b-c272-453b-bd3e-14163b2f10cb tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.569251 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8906cf9b-c272-453b-bd3e-14163b2f10cb tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.570020 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8906cf9b-c272-453b-bd3e-14163b2f10cb tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.570481 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8906cf9b-c272-453b-bd3e-14163b2f10cb tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.673829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d893822f-bf0c-4959-a506-682cc0cbdcb4 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:01.682054 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d893822f-bf0c-4959-a506-682cc0cbdcb4 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1367 microversion: 2.1 time: 0.149321 Jun 07 13:20:01.682890 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 418/831] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:01 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:01.706860 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8906cf9b-c272-453b-bd3e-14163b2f10cb tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:01.714355 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8906cf9b-c272-453b-bd3e-14163b2f10cb tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1520 microversion: 2.1 time: 0.156121 Jun 07 13:20:01.714953 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 414/832] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:01 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:02.238177 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-aafdcca7-0c66-4184-bd8e-31b2ea9c51d7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:02.238727 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-aafdcca7-0c66-4184-bd8e-31b2ea9c51d7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:02.244747 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aafdcca7-0c66-4184-bd8e-31b2ea9c51d7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:02.245197 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aafdcca7-0c66-4184-bd8e-31b2ea9c51d7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:02.245955 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aafdcca7-0c66-4184-bd8e-31b2ea9c51d7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:02.246388 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aafdcca7-0c66-4184-bd8e-31b2ea9c51d7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:02.523519 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-aafdcca7-0c66-4184-bd8e-31b2ea9c51d7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:02.531381 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-aafdcca7-0c66-4184-bd8e-31b2ea9c51d7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1665 microversion: 2.1 time: 0.297093 Jun 07 13:20:02.532044 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 419/833] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:02 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1665 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:02.699130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b1af53b0-78a9-492e-9331-38f57e3656bb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:02.700473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b1af53b0-78a9-492e-9331-38f57e3656bb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:02.707681 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b1af53b0-78a9-492e-9331-38f57e3656bb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:02.708379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b1af53b0-78a9-492e-9331-38f57e3656bb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:02.709335 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b1af53b0-78a9-492e-9331-38f57e3656bb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:02.709843 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b1af53b0-78a9-492e-9331-38f57e3656bb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:02.733239 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-892abbd7-46f1-471f-93e3-bfd4bd2432bc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:02.733853 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-892abbd7-46f1-471f-93e3-bfd4bd2432bc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:02.743996 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-892abbd7-46f1-471f-93e3-bfd4bd2432bc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:02.744445 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-892abbd7-46f1-471f-93e3-bfd4bd2432bc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:02.745258 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-892abbd7-46f1-471f-93e3-bfd4bd2432bc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:02.745666 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-892abbd7-46f1-471f-93e3-bfd4bd2432bc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:02.873792 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b1af53b0-78a9-492e-9331-38f57e3656bb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:02.884535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b1af53b0-78a9-492e-9331-38f57e3656bb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1367 microversion: 2.1 time: 0.189217 Jun 07 13:20:02.885486 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 415/834] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:02 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:03.023626 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-892abbd7-46f1-471f-93e3-bfd4bd2432bc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:03.033573 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-892abbd7-46f1-471f-93e3-bfd4bd2432bc tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1520 microversion: 2.1 time: 0.305002 Jun 07 13:20:03.034790 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 420/835] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:02 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:03.548235 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b7f6cb2c-b8a7-4b07-99cb-3e27d641134c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:03.548761 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b7f6cb2c-b8a7-4b07-99cb-3e27d641134c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:03.554724 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b7f6cb2c-b8a7-4b07-99cb-3e27d641134c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:03.555171 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b7f6cb2c-b8a7-4b07-99cb-3e27d641134c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:03.555926 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b7f6cb2c-b8a7-4b07-99cb-3e27d641134c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:03.556360 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b7f6cb2c-b8a7-4b07-99cb-3e27d641134c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:03.681416 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b7f6cb2c-b8a7-4b07-99cb-3e27d641134c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:03.688819 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b7f6cb2c-b8a7-4b07-99cb-3e27d641134c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1665 microversion: 2.1 time: 0.144519 Jun 07 13:20:03.689383 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 416/836] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:03 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1665 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:03.901046 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-52cc43b9-860b-4057-821e-08e5e0e06c47 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:03.901677 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-52cc43b9-860b-4057-821e-08e5e0e06c47 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:03.908388 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-52cc43b9-860b-4057-821e-08e5e0e06c47 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:03.908832 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-52cc43b9-860b-4057-821e-08e5e0e06c47 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:03.909588 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-52cc43b9-860b-4057-821e-08e5e0e06c47 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:03.910018 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-52cc43b9-860b-4057-821e-08e5e0e06c47 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.034598 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-52cc43b9-860b-4057-821e-08e5e0e06c47 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:04.042276 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-52cc43b9-860b-4057-821e-08e5e0e06c47 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1367 microversion: 2.1 time: 0.145092 Jun 07 13:20:04.042887 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 421/837] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:03 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:04.053311 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-091da4a2-ee7e-40ee-8a28-eaa232cc897c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:04.054032 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-091da4a2-ee7e-40ee-8a28-eaa232cc897c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:04.060305 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-091da4a2-ee7e-40ee-8a28-eaa232cc897c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.060750 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-091da4a2-ee7e-40ee-8a28-eaa232cc897c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.061509 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-091da4a2-ee7e-40ee-8a28-eaa232cc897c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.061937 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-091da4a2-ee7e-40ee-8a28-eaa232cc897c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.194130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-091da4a2-ee7e-40ee-8a28-eaa232cc897c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:04.201952 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-091da4a2-ee7e-40ee-8a28-eaa232cc897c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1576 microversion: 2.1 time: 0.152759 Jun 07 13:20:04.202697 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 417/838] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:04 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:04.705923 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9cacf5c3-4a98-4fa3-bafc-74f3e2a7fbf9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:04.706572 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9cacf5c3-4a98-4fa3-bafc-74f3e2a7fbf9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:04.708587 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:04.709317 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=10 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:04.715700 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9cacf5c3-4a98-4fa3-bafc-74f3e2a7fbf9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.716158 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9cacf5c3-4a98-4fa3-bafc-74f3e2a7fbf9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.716937 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9cacf5c3-4a98-4fa3-bafc-74f3e2a7fbf9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.717383 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9cacf5c3-4a98-4fa3-bafc-74f3e2a7fbf9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.907166 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-d6f3e8d4-3c06-4378-a00f-d11a21bc7dac req-dfc31295-9fc9-4f29-a9db-24079493db00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771de6d7-c5ac-4fe8-9706-dee8ef1564bc", "name": "network-vif-plugged", "status": "completed", "tag": "a1d422ae-82e2-478f-8ea1-ce6ed50756ea"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:04.912915 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=2 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:04.917484 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-d6f3e8d4-3c06-4378-a00f-d11a21bc7dac req-dfc31295-9fc9-4f29-a9db-24079493db00 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.917931 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-d6f3e8d4-3c06-4378-a00f-d11a21bc7dac req-dfc31295-9fc9-4f29-a9db-24079493db00 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.919750 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9cacf5c3-4a98-4fa3-bafc-74f3e2a7fbf9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:04.931364 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9cacf5c3-4a98-4fa3-bafc-74f3e2a7fbf9 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1669 microversion: 2.1 time: 0.229486 Jun 07 13:20:04.932225 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-d6f3e8d4-3c06-4378-a00f-d11a21bc7dac req-dfc31295-9fc9-4f29-a9db-24079493db00 service nova] Creating event network-vif-plugged:a1d422ae-82e2-478f-8ea1-ce6ed50756ea for instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc on hv-cinder-84496 Jun 07 13:20:04.937564 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-d6f3e8d4-3c06-4378-a00f-d11a21bc7dac req-dfc31295-9fc9-4f29-a9db-24079493db00 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034868 Jun 07 13:20:04.938682 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 418/839] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:20:04.941870 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 422/840] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:04 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1669 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:05.060527 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-64ce7fc4-820f-4805-b359-b16948fde878 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:05.061282 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-64ce7fc4-820f-4805-b359-b16948fde878 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:05.068314 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-64ce7fc4-820f-4805-b359-b16948fde878 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:05.068769 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-64ce7fc4-820f-4805-b359-b16948fde878 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:05.069558 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-64ce7fc4-820f-4805-b359-b16948fde878 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:05.069991 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-64ce7fc4-820f-4805-b359-b16948fde878 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:05.204647 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-64ce7fc4-820f-4805-b359-b16948fde878 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:05.212888 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-64ce7fc4-820f-4805-b359-b16948fde878 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1367 microversion: 2.1 time: 0.156803 Jun 07 13:20:05.213696 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 419/841] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:05 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:05.222967 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1cb407c5-540e-4b38-89a8-2f082bdcd461 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:05.222967 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1cb407c5-540e-4b38-89a8-2f082bdcd461 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:05.227106 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1cb407c5-540e-4b38-89a8-2f082bdcd461 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:05.227555 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1cb407c5-540e-4b38-89a8-2f082bdcd461 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:05.228311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1cb407c5-540e-4b38-89a8-2f082bdcd461 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:05.228742 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1cb407c5-540e-4b38-89a8-2f082bdcd461 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:05.624141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1cb407c5-540e-4b38-89a8-2f082bdcd461 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:05.631896 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1cb407c5-540e-4b38-89a8-2f082bdcd461 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1576 microversion: 2.1 time: 0.416066 Jun 07 13:20:05.632457 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 423/842] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:05 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1576 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:06.230546 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3a3e64af-cfce-42d5-b0b9-e574450f9c41 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:06.231086 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3a3e64af-cfce-42d5-b0b9-e574450f9c41 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:06.237579 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3a3e64af-cfce-42d5-b0b9-e574450f9c41 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:06.238033 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3a3e64af-cfce-42d5-b0b9-e574450f9c41 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:06.238835 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3a3e64af-cfce-42d5-b0b9-e574450f9c41 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:06.239255 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3a3e64af-cfce-42d5-b0b9-e574450f9c41 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:06.363993 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3a3e64af-cfce-42d5-b0b9-e574450f9c41 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:06.371426 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3a3e64af-cfce-42d5-b0b9-e574450f9c41 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1367 microversion: 2.1 time: 0.144844 Jun 07 13:20:06.372011 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 420/843] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:06 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:06.649481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e8226d93-8ae2-4558-8606-0d33ae3a441b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:06.650104 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e8226d93-8ae2-4558-8606-0d33ae3a441b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:06.656948 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e8226d93-8ae2-4558-8606-0d33ae3a441b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:06.657397 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e8226d93-8ae2-4558-8606-0d33ae3a441b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:06.658159 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e8226d93-8ae2-4558-8606-0d33ae3a441b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:06.658627 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e8226d93-8ae2-4558-8606-0d33ae3a441b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:06.787341 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e8226d93-8ae2-4558-8606-0d33ae3a441b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:06.794974 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e8226d93-8ae2-4558-8606-0d33ae3a441b tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1576 microversion: 2.1 time: 0.149400 Jun 07 13:20:06.795583 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 424/844] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:06 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:07.388141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1d54eaa4-f961-41ac-9f7e-5b07f62a008c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:07.388757 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1d54eaa4-f961-41ac-9f7e-5b07f62a008c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:07.395420 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1d54eaa4-f961-41ac-9f7e-5b07f62a008c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:07.395868 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1d54eaa4-f961-41ac-9f7e-5b07f62a008c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:07.396628 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1d54eaa4-f961-41ac-9f7e-5b07f62a008c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:07.397067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1d54eaa4-f961-41ac-9f7e-5b07f62a008c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:07.536346 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1d54eaa4-f961-41ac-9f7e-5b07f62a008c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:07.539865 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:07.544683 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1d54eaa4-f961-41ac-9f7e-5b07f62a008c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1367 microversion: 2.1 time: 0.160471 Jun 07 13:20:07.545234 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 421/845] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:07 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:07.812192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-049f497a-e749-46e3-98f5-558a30452da7 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:07.812802 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-049f497a-e749-46e3-98f5-558a30452da7 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:07.819687 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-049f497a-e749-46e3-98f5-558a30452da7 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:07.820140 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-049f497a-e749-46e3-98f5-558a30452da7 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:07.820917 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-049f497a-e749-46e3-98f5-558a30452da7 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:07.821356 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-049f497a-e749-46e3-98f5-558a30452da7 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:07.949816 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-049f497a-e749-46e3-98f5-558a30452da7 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:07.957812 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-049f497a-e749-46e3-98f5-558a30452da7 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1576 microversion: 2.1 time: 0.149627 Jun 07 13:20:07.958385 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 425/846] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:07 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:08.562093 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-71e5b096-faeb-4d71-849c-c7dc70111497 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:08.562733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-71e5b096-faeb-4d71-849c-c7dc70111497 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:08.571634 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-71e5b096-faeb-4d71-849c-c7dc70111497 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:08.572087 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-71e5b096-faeb-4d71-849c-c7dc70111497 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:08.572852 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-71e5b096-faeb-4d71-849c-c7dc70111497 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:08.573295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-71e5b096-faeb-4d71-849c-c7dc70111497 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:08.700866 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-71e5b096-faeb-4d71-849c-c7dc70111497 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:08.708981 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-71e5b096-faeb-4d71-849c-c7dc70111497 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1367 microversion: 2.1 time: 0.150818 Jun 07 13:20:08.709552 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 422/847] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:08 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:08.975553 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-dc810a76-8151-46aa-9d0c-62ecdacb5010 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:08.976265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-dc810a76-8151-46aa-9d0c-62ecdacb5010 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:08.982671 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc810a76-8151-46aa-9d0c-62ecdacb5010 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:08.983126 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc810a76-8151-46aa-9d0c-62ecdacb5010 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:08.984066 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc810a76-8151-46aa-9d0c-62ecdacb5010 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:08.984496 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc810a76-8151-46aa-9d0c-62ecdacb5010 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:08.999769 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:09.118884 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-dc810a76-8151-46aa-9d0c-62ecdacb5010 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:09.130374 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-dc810a76-8151-46aa-9d0c-62ecdacb5010 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1576 microversion: 2.1 time: 0.158899 Jun 07 13:20:09.131010 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 426/848] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:08 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:09.726832 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-228d6bcd-b05a-4d17-9105-a509e9bf6acf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:09.727474 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-228d6bcd-b05a-4d17-9105-a509e9bf6acf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:09.729827 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:09.735924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-228d6bcd-b05a-4d17-9105-a509e9bf6acf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:09.736368 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-228d6bcd-b05a-4d17-9105-a509e9bf6acf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:09.737190 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-228d6bcd-b05a-4d17-9105-a509e9bf6acf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:09.737634 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-228d6bcd-b05a-4d17-9105-a509e9bf6acf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:09.869523 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-228d6bcd-b05a-4d17-9105-a509e9bf6acf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:09.877047 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-228d6bcd-b05a-4d17-9105-a509e9bf6acf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1556 microversion: 2.1 time: 0.154297 Jun 07 13:20:09.877616 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 423/849] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:09 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:09.894386 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bb95e442-4fee-4eb8-80b7-4ec60b629f81 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:09.894916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bb95e442-4fee-4eb8-80b7-4ec60b629f81 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:09.900904 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb95e442-4fee-4eb8-80b7-4ec60b629f81 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:09.901355 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb95e442-4fee-4eb8-80b7-4ec60b629f81 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:09.902122 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb95e442-4fee-4eb8-80b7-4ec60b629f81 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:09.902605 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb95e442-4fee-4eb8-80b7-4ec60b629f81 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:09.977555 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bb95e442-4fee-4eb8-80b7-4ec60b629f81 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087590 Jun 07 13:20:09.978157 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 427/850] 10.222.0.58 () {58 vars in 1274 bytes} [Tue Jun 7 13:20:09 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:10.147386 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-53dd44c9-5870-4375-adef-02a2bd970cf2 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:10.148021 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-53dd44c9-5870-4375-adef-02a2bd970cf2 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:10.154364 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-53dd44c9-5870-4375-adef-02a2bd970cf2 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:10.155097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-53dd44c9-5870-4375-adef-02a2bd970cf2 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:10.155870 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-53dd44c9-5870-4375-adef-02a2bd970cf2 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:10.156293 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-53dd44c9-5870-4375-adef-02a2bd970cf2 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:10.157264 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-029d48b0-aa06-4f59-bd82-0b30137c05fe tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:10.158296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-029d48b0-aa06-4f59-bd82-0b30137c05fe tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:10.164738 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-029d48b0-aa06-4f59-bd82-0b30137c05fe tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:10.165222 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-029d48b0-aa06-4f59-bd82-0b30137c05fe tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:10.166000 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-029d48b0-aa06-4f59-bd82-0b30137c05fe tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:10.166450 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-029d48b0-aa06-4f59-bd82-0b30137c05fe tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:10.248425 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-029d48b0-aa06-4f59-bd82-0b30137c05fe tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "POST /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/action" status: 202 len: 0 microversion: 2.1 time: 0.095590 Jun 07 13:20:10.249770 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 428/851] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jun 7 13:20:10 2022] POST /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 13:20:10.258824 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d48b2147-48a4-4f88-9511-10ffcca663c5 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:10.259824 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d48b2147-48a4-4f88-9511-10ffcca663c5 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:10.267603 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d48b2147-48a4-4f88-9511-10ffcca663c5 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:10.268294 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d48b2147-48a4-4f88-9511-10ffcca663c5 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:10.269413 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d48b2147-48a4-4f88-9511-10ffcca663c5 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:10.270029 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d48b2147-48a4-4f88-9511-10ffcca663c5 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:10.318252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-53dd44c9-5870-4375-adef-02a2bd970cf2 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:10.326021 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-53dd44c9-5870-4375-adef-02a2bd970cf2 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1576 microversion: 2.1 time: 0.182481 Jun 07 13:20:10.326619 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 424/852] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:10 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:10.607549 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d48b2147-48a4-4f88-9511-10ffcca663c5 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:10.615692 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d48b2147-48a4-4f88-9511-10ffcca663c5 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1751 microversion: 2.1 time: 0.361126 Jun 07 13:20:10.616266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 429/853] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:10 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1751 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:11.344789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9961881e-b64b-4e16-b745-c565104f3373 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:11.364782 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-d325bbb8-9dc9-4c3b-bbf5-d5e591554f38 req-9899878b-1fa7-43d6-badb-160a5bcef4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "771de6d7-c5ac-4fe8-9706-dee8ef1564bc", "tag": "a1d422ae-82e2-478f-8ea1-ce6ed50756ea"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:11.367559 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9961881e-b64b-4e16-b745-c565104f3373 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:11.374464 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d325bbb8-9dc9-4c3b-bbf5-d5e591554f38 req-9899878b-1fa7-43d6-badb-160a5bcef4c3 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.374985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d325bbb8-9dc9-4c3b-bbf5-d5e591554f38 req-9899878b-1fa7-43d6-badb-160a5bcef4c3 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:11.375357 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9961881e-b64b-4e16-b745-c565104f3373 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.378987 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9961881e-b64b-4e16-b745-c565104f3373 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:11.379901 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9961881e-b64b-4e16-b745-c565104f3373 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.380342 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9961881e-b64b-4e16-b745-c565104f3373 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:11.386920 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-d325bbb8-9dc9-4c3b-bbf5-d5e591554f38 req-9899878b-1fa7-43d6-badb-160a5bcef4c3 service nova] Creating event network-changed:a1d422ae-82e2-478f-8ea1-ce6ed50756ea for instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc on hv-cinder-84496 Jun 07 13:20:11.391872 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-d325bbb8-9dc9-4c3b-bbf5-d5e591554f38 req-9899878b-1fa7-43d6-badb-160a5bcef4c3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031345 Jun 07 13:20:11.392683 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 430/854] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:20:11.520301 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9961881e-b64b-4e16-b745-c565104f3373 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:11.528509 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9961881e-b64b-4e16-b745-c565104f3373 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1576 microversion: 2.1 time: 0.189049 Jun 07 13:20:11.529745 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 425/855] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:11 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:11.634011 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a741d979-1477-4f54-a4ac-f321d471765a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:11.634743 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a741d979-1477-4f54-a4ac-f321d471765a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:11.642510 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a741d979-1477-4f54-a4ac-f321d471765a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.643063 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a741d979-1477-4f54-a4ac-f321d471765a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:11.644388 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a741d979-1477-4f54-a4ac-f321d471765a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.645035 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a741d979-1477-4f54-a4ac-f321d471765a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:11.880330 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a741d979-1477-4f54-a4ac-f321d471765a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:11.888960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a741d979-1477-4f54-a4ac-f321d471765a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1756 microversion: 2.1 time: 0.259089 Jun 07 13:20:11.889836 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 431/856] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:11 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1756 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:12.546742 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1da490e9-8a02-4c97-bedb-2e3a74d62529 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:12.547348 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1da490e9-8a02-4c97-bedb-2e3a74d62529 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:12.553817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1da490e9-8a02-4c97-bedb-2e3a74d62529 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:12.554261 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1da490e9-8a02-4c97-bedb-2e3a74d62529 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:12.555043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1da490e9-8a02-4c97-bedb-2e3a74d62529 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:12.555470 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1da490e9-8a02-4c97-bedb-2e3a74d62529 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:12.879024 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1da490e9-8a02-4c97-bedb-2e3a74d62529 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:12.886410 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1da490e9-8a02-4c97-bedb-2e3a74d62529 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1576 microversion: 2.1 time: 0.343604 Jun 07 13:20:12.886992 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 426/857] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:12 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1576 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:12.906840 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-15504901-2d01-40f4-b67b-5708a91da670 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:12.907459 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-15504901-2d01-40f4-b67b-5708a91da670 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:12.913971 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15504901-2d01-40f4-b67b-5708a91da670 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:12.914423 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15504901-2d01-40f4-b67b-5708a91da670 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:12.915226 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15504901-2d01-40f4-b67b-5708a91da670 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:12.915665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15504901-2d01-40f4-b67b-5708a91da670 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:13.056442 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-15504901-2d01-40f4-b67b-5708a91da670 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:13.064378 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-15504901-2d01-40f4-b67b-5708a91da670 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1756 microversion: 2.1 time: 0.161658 Jun 07 13:20:13.064952 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 432/858] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:12 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:13.903902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1a2b412a-6360-42a6-bad7-e3de8d5b46df tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:13.904774 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1a2b412a-6360-42a6-bad7-e3de8d5b46df tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:13.911296 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1a2b412a-6360-42a6-bad7-e3de8d5b46df tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:13.911813 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1a2b412a-6360-42a6-bad7-e3de8d5b46df tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:13.912568 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1a2b412a-6360-42a6-bad7-e3de8d5b46df tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:13.913004 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1a2b412a-6360-42a6-bad7-e3de8d5b46df tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:14.038958 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1a2b412a-6360-42a6-bad7-e3de8d5b46df tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:14.046495 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1a2b412a-6360-42a6-bad7-e3de8d5b46df tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1576 microversion: 2.1 time: 0.146442 Jun 07 13:20:14.047066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 427/859] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:13 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:14.081766 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bb30185f-13d9-465d-aac2-c9117567aea9 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:14.082395 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bb30185f-13d9-465d-aac2-c9117567aea9 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:14.088923 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb30185f-13d9-465d-aac2-c9117567aea9 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:14.089315 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb30185f-13d9-465d-aac2-c9117567aea9 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:14.090084 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb30185f-13d9-465d-aac2-c9117567aea9 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:14.090568 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb30185f-13d9-465d-aac2-c9117567aea9 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:14.229929 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bb30185f-13d9-465d-aac2-c9117567aea9 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:14.238730 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bb30185f-13d9-465d-aac2-c9117567aea9 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1756 microversion: 2.1 time: 0.161167 Jun 07 13:20:14.239300 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 433/860] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:14 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:15.067788 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-39381977-eb6f-44e7-ac95-a79463c45000 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:15.068335 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-39381977-eb6f-44e7-ac95-a79463c45000 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:15.075047 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39381977-eb6f-44e7-ac95-a79463c45000 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:15.075501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39381977-eb6f-44e7-ac95-a79463c45000 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:15.076258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39381977-eb6f-44e7-ac95-a79463c45000 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:15.076697 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39381977-eb6f-44e7-ac95-a79463c45000 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:15.209025 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-39381977-eb6f-44e7-ac95-a79463c45000 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:15.216538 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-39381977-eb6f-44e7-ac95-a79463c45000 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1576 microversion: 2.1 time: 0.152695 Jun 07 13:20:15.217107 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 428/861] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:15 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:15.255653 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6017d7b6-8258-4797-8a93-39f939c35b1a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:15.256272 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6017d7b6-8258-4797-8a93-39f939c35b1a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:15.262851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6017d7b6-8258-4797-8a93-39f939c35b1a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:15.263308 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6017d7b6-8258-4797-8a93-39f939c35b1a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:15.264074 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6017d7b6-8258-4797-8a93-39f939c35b1a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:15.264520 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6017d7b6-8258-4797-8a93-39f939c35b1a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:15.407849 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6017d7b6-8258-4797-8a93-39f939c35b1a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:15.416331 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6017d7b6-8258-4797-8a93-39f939c35b1a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1756 microversion: 2.1 time: 0.164602 Jun 07 13:20:15.416903 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 434/862] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:15 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:16.234130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b811f5f6-7e48-4ec2-a320-c196b1f6197c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:16.234680 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b811f5f6-7e48-4ec2-a320-c196b1f6197c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:16.241058 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b811f5f6-7e48-4ec2-a320-c196b1f6197c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:16.241502 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b811f5f6-7e48-4ec2-a320-c196b1f6197c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:16.242280 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b811f5f6-7e48-4ec2-a320-c196b1f6197c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:16.242740 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b811f5f6-7e48-4ec2-a320-c196b1f6197c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:16.368692 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b811f5f6-7e48-4ec2-a320-c196b1f6197c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:16.376335 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b811f5f6-7e48-4ec2-a320-c196b1f6197c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1576 microversion: 2.1 time: 0.146115 Jun 07 13:20:16.376896 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 429/863] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:16 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1576 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:16.433269 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e5abaacb-a3bb-408f-9dfa-174454efb24c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:16.433876 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e5abaacb-a3bb-408f-9dfa-174454efb24c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:16.440286 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5abaacb-a3bb-408f-9dfa-174454efb24c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:16.441249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5abaacb-a3bb-408f-9dfa-174454efb24c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:16.441994 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5abaacb-a3bb-408f-9dfa-174454efb24c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:16.442456 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5abaacb-a3bb-408f-9dfa-174454efb24c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:16.579323 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e5abaacb-a3bb-408f-9dfa-174454efb24c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:16.587092 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e5abaacb-a3bb-408f-9dfa-174454efb24c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1756 microversion: 2.1 time: 0.157652 Jun 07 13:20:16.587651 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 435/864] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:16 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:16.991976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-c078398f-f378-4c2d-8568-712d7c057ceb req-534f061f-153c-44dd-87ca-a81ed420d602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e18880-cb5c-4346-9a43-a861b07f27a8", "name": "network-vif-plugged", "status": "completed", "tag": "d0c830a1-4526-4f25-a02e-0ee9838a85ba"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:17.000557 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-c078398f-f378-4c2d-8568-712d7c057ceb req-534f061f-153c-44dd-87ca-a81ed420d602 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:17.001065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-c078398f-f378-4c2d-8568-712d7c057ceb req-534f061f-153c-44dd-87ca-a81ed420d602 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:17.013752 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-c078398f-f378-4c2d-8568-712d7c057ceb req-534f061f-153c-44dd-87ca-a81ed420d602 service nova] Creating event network-vif-plugged:d0c830a1-4526-4f25-a02e-0ee9838a85ba for instance 25e18880-cb5c-4346-9a43-a861b07f27a8 on hv-cinder-84496 Jun 07 13:20:17.018975 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-c078398f-f378-4c2d-8568-712d7c057ceb req-534f061f-153c-44dd-87ca-a81ed420d602 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030591 Jun 07 13:20:17.019566 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 430/865] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:17.395672 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2d0cfbb0-a0d4-40ee-bd5e-a047be4ba8b3 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:17.396289 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2d0cfbb0-a0d4-40ee-bd5e-a047be4ba8b3 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:17.402389 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2d0cfbb0-a0d4-40ee-bd5e-a047be4ba8b3 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:17.402869 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2d0cfbb0-a0d4-40ee-bd5e-a047be4ba8b3 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:17.403635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2d0cfbb0-a0d4-40ee-bd5e-a047be4ba8b3 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:17.404072 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2d0cfbb0-a0d4-40ee-bd5e-a047be4ba8b3 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:17.531178 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2d0cfbb0-a0d4-40ee-bd5e-a047be4ba8b3 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:17.538634 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2d0cfbb0-a0d4-40ee-bd5e-a047be4ba8b3 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1576 microversion: 2.1 time: 0.147304 Jun 07 13:20:17.539199 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 436/866] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:17 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:17.604613 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-dcd5d28f-3304-4cd7-908d-d8a9a23f9917 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:17.605263 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-dcd5d28f-3304-4cd7-908d-d8a9a23f9917 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:17.611918 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dcd5d28f-3304-4cd7-908d-d8a9a23f9917 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:17.612365 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dcd5d28f-3304-4cd7-908d-d8a9a23f9917 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:17.613127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dcd5d28f-3304-4cd7-908d-d8a9a23f9917 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:17.613565 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dcd5d28f-3304-4cd7-908d-d8a9a23f9917 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:17.760401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-dcd5d28f-3304-4cd7-908d-d8a9a23f9917 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:17.769126 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-dcd5d28f-3304-4cd7-908d-d8a9a23f9917 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1756 microversion: 2.1 time: 0.168399 Jun 07 13:20:17.769681 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 431/867] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:17 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:18.555813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-223f5ada-f9b7-4ffa-9f7b-7c73dd0639c6 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:18.556419 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-223f5ada-f9b7-4ffa-9f7b-7c73dd0639c6 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:18.562831 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-223f5ada-f9b7-4ffa-9f7b-7c73dd0639c6 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:18.563275 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-223f5ada-f9b7-4ffa-9f7b-7c73dd0639c6 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:18.564026 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-223f5ada-f9b7-4ffa-9f7b-7c73dd0639c6 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:18.564456 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-223f5ada-f9b7-4ffa-9f7b-7c73dd0639c6 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:18.692373 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-223f5ada-f9b7-4ffa-9f7b-7c73dd0639c6 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:18.699974 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-223f5ada-f9b7-4ffa-9f7b-7c73dd0639c6 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1576 microversion: 2.1 time: 0.147969 Jun 07 13:20:18.700490 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 437/868] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:18 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:18.787058 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-235e360e-815a-4fcf-b961-54cfec5c8301 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:18.787685 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-235e360e-815a-4fcf-b961-54cfec5c8301 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:18.794005 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-235e360e-815a-4fcf-b961-54cfec5c8301 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:18.794478 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-235e360e-815a-4fcf-b961-54cfec5c8301 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:18.795261 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-235e360e-815a-4fcf-b961-54cfec5c8301 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:18.795699 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-235e360e-815a-4fcf-b961-54cfec5c8301 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:18.933594 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-235e360e-815a-4fcf-b961-54cfec5c8301 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:18.942090 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-235e360e-815a-4fcf-b961-54cfec5c8301 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1756 microversion: 2.1 time: 0.159617 Jun 07 13:20:18.942793 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 432/869] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:18 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:19.716985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e0938620-57c6-42c7-85f5-9ef5d288520d tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:19.717626 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e0938620-57c6-42c7-85f5-9ef5d288520d tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:19.724773 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e0938620-57c6-42c7-85f5-9ef5d288520d tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:19.725224 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e0938620-57c6-42c7-85f5-9ef5d288520d tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:19.725985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e0938620-57c6-42c7-85f5-9ef5d288520d tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:19.726446 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e0938620-57c6-42c7-85f5-9ef5d288520d tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:19.867560 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e0938620-57c6-42c7-85f5-9ef5d288520d tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:19.875008 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e0938620-57c6-42c7-85f5-9ef5d288520d tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1563 microversion: 2.1 time: 0.161869 Jun 07 13:20:19.875577 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 438/870] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:19 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:19.959544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-bdfa5169-d9e2-41e0-8e48-f03890144df6 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:19.960160 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-bdfa5169-d9e2-41e0-8e48-f03890144df6 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:19.966598 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bdfa5169-d9e2-41e0-8e48-f03890144df6 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:19.967110 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bdfa5169-d9e2-41e0-8e48-f03890144df6 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:19.967820 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bdfa5169-d9e2-41e0-8e48-f03890144df6 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:19.968258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bdfa5169-d9e2-41e0-8e48-f03890144df6 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:20.111441 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-bdfa5169-d9e2-41e0-8e48-f03890144df6 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:20.119613 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-bdfa5169-d9e2-41e0-8e48-f03890144df6 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1756 microversion: 2.1 time: 0.164419 Jun 07 13:20:20.120185 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 433/871] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:19 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:21.137177 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bf890ef5-838b-4ccd-bb15-b9736e1420cc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:21.137823 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bf890ef5-838b-4ccd-bb15-b9736e1420cc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:21.144980 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf890ef5-838b-4ccd-bb15-b9736e1420cc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:21.145426 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf890ef5-838b-4ccd-bb15-b9736e1420cc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:21.146188 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf890ef5-838b-4ccd-bb15-b9736e1420cc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:21.146654 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf890ef5-838b-4ccd-bb15-b9736e1420cc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:21.285517 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bf890ef5-838b-4ccd-bb15-b9736e1420cc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:21.293421 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bf890ef5-838b-4ccd-bb15-b9736e1420cc tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1756 microversion: 2.1 time: 0.160139 Jun 07 13:20:21.293985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 439/872] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:21 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:22.309964 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7b404879-3854-4be6-80eb-b130692b6e89 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:22.310633 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7b404879-3854-4be6-80eb-b130692b6e89 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:22.317115 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7b404879-3854-4be6-80eb-b130692b6e89 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:22.317563 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7b404879-3854-4be6-80eb-b130692b6e89 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:22.318319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7b404879-3854-4be6-80eb-b130692b6e89 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:22.318781 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7b404879-3854-4be6-80eb-b130692b6e89 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:22.458873 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-7b404879-3854-4be6-80eb-b130692b6e89 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:22.466817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-7b404879-3854-4be6-80eb-b130692b6e89 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1756 microversion: 2.1 time: 0.160672 Jun 07 13:20:22.467377 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 434/873] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:22 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:23.484355 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b8841ddd-52fc-43c6-8726-89b37490e282 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:23.484951 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b8841ddd-52fc-43c6-8726-89b37490e282 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:23.491448 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b8841ddd-52fc-43c6-8726-89b37490e282 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:23.491890 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b8841ddd-52fc-43c6-8726-89b37490e282 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:23.492640 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b8841ddd-52fc-43c6-8726-89b37490e282 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:23.493070 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b8841ddd-52fc-43c6-8726-89b37490e282 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:23.634000 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b8841ddd-52fc-43c6-8726-89b37490e282 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:23.641954 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b8841ddd-52fc-43c6-8726-89b37490e282 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1759 microversion: 2.1 time: 0.161482 Jun 07 13:20:23.642546 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 440/874] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:23 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:29.479501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8b11e997-6632-4496-9278-6c2634d5b885 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:29.480075 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8b11e997-6632-4496-9278-6c2634d5b885 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:29.486703 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8b11e997-6632-4496-9278-6c2634d5b885 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:29.487164 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8b11e997-6632-4496-9278-6c2634d5b885 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:29.487927 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8b11e997-6632-4496-9278-6c2634d5b885 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:29.488369 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8b11e997-6632-4496-9278-6c2634d5b885 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:29.516001 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8b11e997-6632-4496-9278-6c2634d5b885 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/os-volume_attachments/bbae8004-ce6f-4e92-9ff5-9bbea8a3c8a8" status: 200 len: 194 microversion: 2.20 time: 0.040535 Jun 07 13:20:29.516553 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 435/875] 10.222.0.58 () {60 vars in 1453 bytes} [Tue Jun 7 13:20:29 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/os-volume_attachments/bbae8004-ce6f-4e92-9ff5-9bbea8a3c8a8 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:20:29.577055 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-552f92fb-d6f8-48ed-9ff3-a78c3b5ce3a1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:29.577558 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-552f92fb-d6f8-48ed-9ff3-a78c3b5ce3a1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:29.580123 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:29.586045 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-552f92fb-d6f8-48ed-9ff3-a78c3b5ce3a1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:29.586521 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-552f92fb-d6f8-48ed-9ff3-a78c3b5ce3a1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:29.587288 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-552f92fb-d6f8-48ed-9ff3-a78c3b5ce3a1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:29.587728 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-552f92fb-d6f8-48ed-9ff3-a78c3b5ce3a1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:29.670536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-552f92fb-d6f8-48ed-9ff3-a78c3b5ce3a1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lazy-loading 'services' on Instance uuid 64eec94b-9fac-4ad4-8386-01a27db4d5ce {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:20:29.740212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-552f92fb-d6f8-48ed-9ff3-a78c3b5ce3a1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/os-volume_attachments/bbae8004-ce6f-4e92-9ff5-9bbea8a3c8a8" status: 202 len: 0 microversion: 2.20 time: 0.167269 Jun 07 13:20:29.740797 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 441/876] 10.222.0.58 () {60 vars in 1456 bytes} [Tue Jun 7 13:20:29 2022] DELETE /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/os-volume_attachments/bbae8004-ce6f-4e92-9ff5-9bbea8a3c8a8 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:20:29.749187 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e11e941e-36ca-4a62-a9c8-148a6d4b2bd3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:29.750205 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-e11e941e-36ca-4a62-a9c8-148a6d4b2bd3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:29.756303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e11e941e-36ca-4a62-a9c8-148a6d4b2bd3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:29.756803 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e11e941e-36ca-4a62-a9c8-148a6d4b2bd3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:29.757657 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e11e941e-36ca-4a62-a9c8-148a6d4b2bd3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:29.758235 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e11e941e-36ca-4a62-a9c8-148a6d4b2bd3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:29.788959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e11e941e-36ca-4a62-a9c8-148a6d4b2bd3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043707 Jun 07 13:20:29.789523 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 436/877] 10.222.0.58 () {60 vars in 1342 bytes} [Tue Jun 7 13:20:29 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:20:30.801673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6126ee54-89ea-45e4-b82c-ad1327187caf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:30.802765 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6126ee54-89ea-45e4-b82c-ad1327187caf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:30.808986 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6126ee54-89ea-45e4-b82c-ad1327187caf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:30.809436 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6126ee54-89ea-45e4-b82c-ad1327187caf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:30.810188 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6126ee54-89ea-45e4-b82c-ad1327187caf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:30.810651 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6126ee54-89ea-45e4-b82c-ad1327187caf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:30.824522 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:30.847731 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6126ee54-89ea-45e4-b82c-ad1327187caf tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050810 Jun 07 13:20:30.848239 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 442/878] 10.222.0.58 () {60 vars in 1342 bytes} [Tue Jun 7 13:20:30 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:20:31.859402 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-fed88366-4261-4580-9d96-d8c3310b65c2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:31.860316 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-fed88366-4261-4580-9d96-d8c3310b65c2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:31.866534 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fed88366-4261-4580-9d96-d8c3310b65c2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:31.866986 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fed88366-4261-4580-9d96-d8c3310b65c2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:31.867740 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fed88366-4261-4580-9d96-d8c3310b65c2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:31.868177 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fed88366-4261-4580-9d96-d8c3310b65c2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:31.896509 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-fed88366-4261-4580-9d96-d8c3310b65c2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041106 Jun 07 13:20:31.897248 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 437/879] 10.222.0.58 () {60 vars in 1342 bytes} [Tue Jun 7 13:20:31 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:31.954634 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ed56934a-8b79-4c7e-b5bf-b7d4da1c4bd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:31.955149 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ed56934a-8b79-4c7e-b5bf-b7d4da1c4bd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:31.961951 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed56934a-8b79-4c7e-b5bf-b7d4da1c4bd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:31.962398 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed56934a-8b79-4c7e-b5bf-b7d4da1c4bd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:31.963182 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed56934a-8b79-4c7e-b5bf-b7d4da1c4bd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:31.963618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed56934a-8b79-4c7e-b5bf-b7d4da1c4bd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:31.988187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ed56934a-8b79-4c7e-b5bf-b7d4da1c4bd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:20:32.059475 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ed56934a-8b79-4c7e-b5bf-b7d4da1c4bd4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 204 len: 0 microversion: 2.20 time: 0.108406 Jun 07 13:20:32.060304 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 443/880] 10.222.0.58 () {60 vars in 1279 bytes} [Tue Jun 7 13:20:31 2022] DELETE /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 13:20:32.068267 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d9cf379b-2add-4ab4-9403-51d6d244f897 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:32.068870 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d9cf379b-2add-4ab4-9403-51d6d244f897 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:32.075075 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d9cf379b-2add-4ab4-9403-51d6d244f897 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.075618 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d9cf379b-2add-4ab4-9403-51d6d244f897 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:32.076388 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d9cf379b-2add-4ab4-9403-51d6d244f897 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.076845 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d9cf379b-2add-4ab4-9403-51d6d244f897 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:32.204695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d9cf379b-2add-4ab4-9403-51d6d244f897 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:32.213241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d9cf379b-2add-4ab4-9403-51d6d244f897 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:32.214759 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d9cf379b-2add-4ab4-9403-51d6d244f897 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:32.215902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d9cf379b-2add-4ab4-9403-51d6d244f897 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.151666 Jun 07 13:20:32.216482 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 438/881] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:32 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:20:33.234980 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9a043a62-90e1-411a-9d41-8afdb9dc753c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:33.235688 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9a043a62-90e1-411a-9d41-8afdb9dc753c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:33.242581 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9a043a62-90e1-411a-9d41-8afdb9dc753c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:33.243039 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9a043a62-90e1-411a-9d41-8afdb9dc753c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:33.243803 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9a043a62-90e1-411a-9d41-8afdb9dc753c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:33.244242 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9a043a62-90e1-411a-9d41-8afdb9dc753c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:33.370952 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9a043a62-90e1-411a-9d41-8afdb9dc753c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:33.379500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9a043a62-90e1-411a-9d41-8afdb9dc753c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:33.381048 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9a043a62-90e1-411a-9d41-8afdb9dc753c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:33.382209 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9a043a62-90e1-411a-9d41-8afdb9dc753c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.151658 Jun 07 13:20:33.382808 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 444/882] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:33 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:34.400584 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-cbf62db5-837c-4e5f-b9c9-04676e88025c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:34.401188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-cbf62db5-837c-4e5f-b9c9-04676e88025c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:34.408724 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cbf62db5-837c-4e5f-b9c9-04676e88025c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:34.409188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cbf62db5-837c-4e5f-b9c9-04676e88025c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:34.409976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cbf62db5-837c-4e5f-b9c9-04676e88025c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:34.410413 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cbf62db5-837c-4e5f-b9c9-04676e88025c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:34.414896 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:34.548594 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cbf62db5-837c-4e5f-b9c9-04676e88025c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:34.557679 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cbf62db5-837c-4e5f-b9c9-04676e88025c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:34.559231 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cbf62db5-837c-4e5f-b9c9-04676e88025c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:34.560413 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-cbf62db5-837c-4e5f-b9c9-04676e88025c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1722 microversion: 2.20 time: 0.163851 Jun 07 13:20:34.560970 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 439/883] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:34 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:35.319379 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-138911ed-f1a4-4aa8-a96d-f82b298fd0f0 req-471831e2-caab-4a28-9e91-04a3e06e325a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64eec94b-9fac-4ad4-8386-01a27db4d5ce", "name": "network-vif-deleted", "tag": "689501bc-bf08-4b3c-8c94-bc415ab172a1"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:35.331041 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-138911ed-f1a4-4aa8-a96d-f82b298fd0f0 req-471831e2-caab-4a28-9e91-04a3e06e325a service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:35.331497 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-138911ed-f1a4-4aa8-a96d-f82b298fd0f0 req-471831e2-caab-4a28-9e91-04a3e06e325a service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:35.344470 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-138911ed-f1a4-4aa8-a96d-f82b298fd0f0 req-471831e2-caab-4a28-9e91-04a3e06e325a service nova] Creating event network-vif-deleted:689501bc-bf08-4b3c-8c94-bc415ab172a1 for instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce on hv-cinder-84496 Jun 07 13:20:35.350235 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-138911ed-f1a4-4aa8-a96d-f82b298fd0f0 req-471831e2-caab-4a28-9e91-04a3e06e325a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034302 Jun 07 13:20:35.351175 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 445/884] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:20:35.578652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-088bc82d-92c5-4318-972a-68accedbbdc2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:35.579412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-088bc82d-92c5-4318-972a-68accedbbdc2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:35.586727 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-088bc82d-92c5-4318-972a-68accedbbdc2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:35.587299 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-088bc82d-92c5-4318-972a-68accedbbdc2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:35.588207 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-088bc82d-92c5-4318-972a-68accedbbdc2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:35.588746 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-088bc82d-92c5-4318-972a-68accedbbdc2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:35.620135 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-088bc82d-92c5-4318-972a-68accedbbdc2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:35.620587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-088bc82d-92c5-4318-972a-68accedbbdc2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:35.621036 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-088bc82d-92c5-4318-972a-68accedbbdc2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lazy-loading 'fault' on Instance uuid 64eec94b-9fac-4ad4-8386-01a27db4d5ce {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:20:35.661608 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-088bc82d-92c5-4318-972a-68accedbbdc2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:35.670516 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-088bc82d-92c5-4318-972a-68accedbbdc2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:35.672037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-088bc82d-92c5-4318-972a-68accedbbdc2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:35.673499 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-088bc82d-92c5-4318-972a-68accedbbdc2 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 200 len: 1371 microversion: 2.20 time: 0.098773 Jun 07 13:20:35.674093 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 440/885] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:35 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:36.692327 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-087709f3-ffaa-4077-afb3-78941d65f453 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:36.692938 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-087709f3-ffaa-4077-afb3-78941d65f453 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:36.699545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-087709f3-ffaa-4077-afb3-78941d65f453 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:36.699992 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-087709f3-ffaa-4077-afb3-78941d65f453 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:36.700742 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-087709f3-ffaa-4077-afb3-78941d65f453 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:36.701173 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-087709f3-ffaa-4077-afb3-78941d65f453 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:36.713940 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-087709f3-ffaa-4077-afb3-78941d65f453 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] HTTP exception thrown: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-087709f3-ffaa-4077-afb3-78941d65f453 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Request method failure captured: Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce HTTP/1.1 Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08eIhtdXfyY-F6iLKNsk0VbMyGisWXTCPrvVkXrvT5fDCJuyZZcw7-T-Jncv8mPCJhGVeh-VFdBTSoFpLTmtb7RJQ_7yh9n40ks2CytmiZKVHPovMsBqOMXed6fGVqD0nYtaIzBTCdHz2DgCiEadMveyYNRYGgOlFL_JesnL_gtjAY Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 1415de13612d47928af70862de8576be Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:20:36.715563 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:20:36.717247 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1415de13612d47928af70862de8576be", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1415de13612d47928af70862de8576be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1415de13612d47928af70862de8576be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1415de13612d47928af70862de8576be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:20:36.717247 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:20:36.717247 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 1415de13612d47928af70862de8576be Jun 07 13:20:36.717247 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:20:36.717247 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeShelveTestJSON-1678106582-project Jun 07 13:20:36.717247 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:20:36.717247 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:20:36.717247 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: c1785cda265641259d831cb0b6a6a34b Jun 07 13:20:36.717247 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1678106582-project Jun 07 13:20:36.717247 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:20:36.717247 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. Jun 07 13:20:36.717247 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': '64eec94b-9fac-4ad4-8386-01a27db4d5ce'} Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:20:36.718296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. Jun 07 13:20:36.719787 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:20:36.721770 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-087709f3-ffaa-4077-afb3-78941d65f453 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Returning 404 to user: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:20:36.721770 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-087709f3-ffaa-4077-afb3-78941d65f453 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 404 len: 111 microversion: 2.20 time: 0.028985 Jun 07 13:20:36.721770 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 446/886] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:36 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:20:36.726222 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-76685731-02db-4d94-b8b9-ee3e8c530aec tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '.version_select at 0x7fb8f8f63ca0>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:36.743811 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-76685731-02db-4d94-b8b9-ee3e8c530aec tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874319868" status: 204 len: 0 microversion: 2.20 time: 0.021387 Jun 07 13:20:36.744367 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 441/887] 10.222.0.58 () {60 vars in 1261 bytes} [Tue Jun 7 13:20:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874319868 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 13:20:37.393818 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-de52aff5-011e-4171-9787-ee96595f3c19 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Action: 'create', calling method: .version_select at 0x7fb8f90ba4c0>, body: {"keypair": {"name": "tempest-keypair-1557192866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObx2gXuiyU4vIziVeUXlbMp+hHrcjrzICg38wN6Xf+2lrXrtTHc0XhQ54lVB/AuU178eLePfjShBc8B6tqWW4b4KuwygP+sw/e1mDdFRfBwSodvb2dXjkzy3O2p6IyhRA=="}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:37.407498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-de52aff5-011e-4171-9787-ee96595f3c19 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Getting quotas for project 1415de13612d47928af70862de8576be. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:20:37.411178 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-de52aff5-011e-4171-9787-ee96595f3c19 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Getting quotas for user c1785cda265641259d831cb0b6a6a34b and project 1415de13612d47928af70862de8576be. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:20:37.431318 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-de52aff5-011e-4171-9787-ee96595f3c19 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.042056 Jun 07 13:20:37.431882 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 447/888] 10.222.0.58 () {62 vars in 1199 bytes} [Tue Jun 7 13:20:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 43 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 07 13:20:38.682582 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7e1dcd83-73c6-44e1-b8fb-707d3433269a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-797323375", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da70da4e-9138-45ce-9988-0dcf0221903b"}], "security_groups": [{"name": "tempest-securitygroup--1401717831"}], "key_name": "tempest-keypair-1557192866", "user_data": "}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:38.782933 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.network.neutron [None req-7e1dcd83-73c6-44e1-b8fb-707d3433269a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] validate_networks() for [('da70da4e-9138-45ce-9988-0dcf0221903b', None, None, None, None, None)] {{(pid=117797) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:20:39.129600 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-7e1dcd83-73c6-44e1-b8fb-707d3433269a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Flavor limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:20:39.130034 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-7e1dcd83-73c6-44e1-b8fb-707d3433269a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Image limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:20:39.130544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-7e1dcd83-73c6-44e1-b8fb-707d3433269a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Flavor pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:20:39.130957 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-7e1dcd83-73c6-44e1-b8fb-707d3433269a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Image pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:20:39.131397 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-7e1dcd83-73c6-44e1-b8fb-707d3433269a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:20:39.140173 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7e1dcd83-73c6-44e1-b8fb-707d3433269a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:39.140620 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7e1dcd83-73c6-44e1-b8fb-707d3433269a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:39.141411 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7e1dcd83-73c6-44e1-b8fb-707d3433269a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:39.141847 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7e1dcd83-73c6-44e1-b8fb-707d3433269a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:39.158851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-7e1dcd83-73c6-44e1-b8fb-707d3433269a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Getting quotas for project 1415de13612d47928af70862de8576be. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:20:39.162721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-7e1dcd83-73c6-44e1-b8fb-707d3433269a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Getting quotas for user c1785cda265641259d831cb0b6a6a34b and project 1415de13612d47928af70862de8576be. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:20:39.173354 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7e1dcd83-73c6-44e1-b8fb-707d3433269a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Going to run 1 instances... {{(pid=117797) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:20:39.175599 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7e1dcd83-73c6-44e1-b8fb-707d3433269a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:20:39.222155 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-7e1dcd83-73c6-44e1-b8fb-707d3433269a tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.544448 Jun 07 13:20:39.222834 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 442/889] 10.222.0.58 () {62 vars in 1187 bytes} [Tue Jun 7 13:20:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 13:20:39.233678 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d6842bfd-19fb-4a05-9c6a-88a2e6a68114 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:39.234294 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d6842bfd-19fb-4a05-9c6a-88a2e6a68114 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:39.288436 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d6842bfd-19fb-4a05-9c6a-88a2e6a68114 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:39.295721 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d6842bfd-19fb-4a05-9c6a-88a2e6a68114 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:39.297243 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d6842bfd-19fb-4a05-9c6a-88a2e6a68114 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:39.298384 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d6842bfd-19fb-4a05-9c6a-88a2e6a68114 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1281 microversion: 2.20 time: 0.069446 Jun 07 13:20:39.299475 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 448/890] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:39 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:40.317258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-196fc203-42d4-45b1-b1e9-876911f51b86 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:40.318557 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-196fc203-42d4-45b1-b1e9-876911f51b86 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:40.321211 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:40.329059 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-196fc203-42d4-45b1-b1e9-876911f51b86 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:40.329513 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-196fc203-42d4-45b1-b1e9-876911f51b86 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:40.331956 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-196fc203-42d4-45b1-b1e9-876911f51b86 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:40.332804 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-196fc203-42d4-45b1-b1e9-876911f51b86 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:40.399949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-196fc203-42d4-45b1-b1e9-876911f51b86 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:40.408821 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-196fc203-42d4-45b1-b1e9-876911f51b86 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:40.410468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-196fc203-42d4-45b1-b1e9-876911f51b86 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:40.411550 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-196fc203-42d4-45b1-b1e9-876911f51b86 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1351 microversion: 2.20 time: 0.099210 Jun 07 13:20:40.412109 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 443/891] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:40 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:41.429639 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d85163c9-0f64-4fee-b469-3edf10d74395 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:41.430195 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d85163c9-0f64-4fee-b469-3edf10d74395 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:41.436647 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d85163c9-0f64-4fee-b469-3edf10d74395 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:41.437095 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d85163c9-0f64-4fee-b469-3edf10d74395 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:41.437866 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d85163c9-0f64-4fee-b469-3edf10d74395 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:41.438301 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d85163c9-0f64-4fee-b469-3edf10d74395 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:41.672579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d85163c9-0f64-4fee-b469-3edf10d74395 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:41.682059 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d85163c9-0f64-4fee-b469-3edf10d74395 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:41.683521 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d85163c9-0f64-4fee-b469-3edf10d74395 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:41.684660 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d85163c9-0f64-4fee-b469-3edf10d74395 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1407 microversion: 2.20 time: 0.259016 Jun 07 13:20:41.685222 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 449/892] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:41 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:41.822475 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-1960183a-a1b3-4eaf-9645-7038edfd7056 req-f08475db-9441-496a-9b64-8fd4f0d831bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7a49f1-361e-4684-9134-0ba52665297b", "tag": "5cbf5f8c-af01-4a2e-8f16-dd54822bb4cd"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:41.840484 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-1960183a-a1b3-4eaf-9645-7038edfd7056 req-f08475db-9441-496a-9b64-8fd4f0d831bb service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:41.841181 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-1960183a-a1b3-4eaf-9645-7038edfd7056 req-f08475db-9441-496a-9b64-8fd4f0d831bb service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:41.855548 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-1960183a-a1b3-4eaf-9645-7038edfd7056 req-f08475db-9441-496a-9b64-8fd4f0d831bb service nova] Creating event network-changed:5cbf5f8c-af01-4a2e-8f16-dd54822bb4cd for instance af7a49f1-361e-4684-9134-0ba52665297b on hv-cinder-84496 Jun 07 13:20:41.862684 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-1960183a-a1b3-4eaf-9645-7038edfd7056 req-f08475db-9441-496a-9b64-8fd4f0d831bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043790 Jun 07 13:20:41.863470 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 444/893] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:20:42.702871 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-926f5cfc-0d83-464b-848e-3a21244d77b1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:42.703477 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-926f5cfc-0d83-464b-848e-3a21244d77b1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:42.709638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-926f5cfc-0d83-464b-848e-3a21244d77b1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:42.710082 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-926f5cfc-0d83-464b-848e-3a21244d77b1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:42.710855 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-926f5cfc-0d83-464b-848e-3a21244d77b1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:42.711286 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-926f5cfc-0d83-464b-848e-3a21244d77b1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:42.840380 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-926f5cfc-0d83-464b-848e-3a21244d77b1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:42.848374 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-926f5cfc-0d83-464b-848e-3a21244d77b1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:42.849888 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-926f5cfc-0d83-464b-848e-3a21244d77b1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:42.851019 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-926f5cfc-0d83-464b-848e-3a21244d77b1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1407 microversion: 2.20 time: 0.152203 Jun 07 13:20:42.851576 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 450/894] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:42 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:43.869257 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-403afce7-fb94-497e-bde5-b22165d4ca0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:43.869990 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-403afce7-fb94-497e-bde5-b22165d4ca0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:43.877279 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-403afce7-fb94-497e-bde5-b22165d4ca0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:43.877732 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-403afce7-fb94-497e-bde5-b22165d4ca0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:43.878524 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-403afce7-fb94-497e-bde5-b22165d4ca0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:43.878964 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-403afce7-fb94-497e-bde5-b22165d4ca0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:44.006310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-403afce7-fb94-497e-bde5-b22165d4ca0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:44.014182 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-403afce7-fb94-497e-bde5-b22165d4ca0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:44.015720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-403afce7-fb94-497e-bde5-b22165d4ca0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:44.016823 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-403afce7-fb94-497e-bde5-b22165d4ca0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1407 microversion: 2.20 time: 0.151834 Jun 07 13:20:44.017977 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 445/895] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:43 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:45.035717 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5e9e469d-c783-4f53-8d8f-cf42440d48e1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:45.036234 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5e9e469d-c783-4f53-8d8f-cf42440d48e1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:45.042871 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e9e469d-c783-4f53-8d8f-cf42440d48e1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:45.043329 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e9e469d-c783-4f53-8d8f-cf42440d48e1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:45.044102 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e9e469d-c783-4f53-8d8f-cf42440d48e1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:45.044543 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e9e469d-c783-4f53-8d8f-cf42440d48e1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:45.249114 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5e9e469d-c783-4f53-8d8f-cf42440d48e1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:45.257535 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5e9e469d-c783-4f53-8d8f-cf42440d48e1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:45.259102 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5e9e469d-c783-4f53-8d8f-cf42440d48e1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:45.260225 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5e9e469d-c783-4f53-8d8f-cf42440d48e1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1407 microversion: 2.20 time: 0.229127 Jun 07 13:20:45.261008 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 451/896] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:45 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:46.278602 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-fe322819-e8df-4aec-85cb-5350b3cf2056 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:46.279466 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-fe322819-e8df-4aec-85cb-5350b3cf2056 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:46.286341 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fe322819-e8df-4aec-85cb-5350b3cf2056 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:46.286815 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fe322819-e8df-4aec-85cb-5350b3cf2056 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:46.287561 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fe322819-e8df-4aec-85cb-5350b3cf2056 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:46.287987 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fe322819-e8df-4aec-85cb-5350b3cf2056 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:46.416101 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-fe322819-e8df-4aec-85cb-5350b3cf2056 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:46.423845 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-fe322819-e8df-4aec-85cb-5350b3cf2056 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:46.425331 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-fe322819-e8df-4aec-85cb-5350b3cf2056 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:46.426418 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-fe322819-e8df-4aec-85cb-5350b3cf2056 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1407 microversion: 2.20 time: 0.151871 Jun 07 13:20:46.426995 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 446/897] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:46 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:47.221557 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-6a8058ce-4a73-4b77-bc80-15b20390d902 req-93decfb9-511f-4987-abfc-26cb752403a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7a49f1-361e-4684-9134-0ba52665297b", "name": "network-vif-plugged", "status": "completed", "tag": "5cbf5f8c-af01-4a2e-8f16-dd54822bb4cd"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:47.230629 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-6a8058ce-4a73-4b77-bc80-15b20390d902 req-93decfb9-511f-4987-abfc-26cb752403a5 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:47.231846 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-6a8058ce-4a73-4b77-bc80-15b20390d902 req-93decfb9-511f-4987-abfc-26cb752403a5 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:47.244093 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-6a8058ce-4a73-4b77-bc80-15b20390d902 req-93decfb9-511f-4987-abfc-26cb752403a5 service nova] Creating event network-vif-plugged:5cbf5f8c-af01-4a2e-8f16-dd54822bb4cd for instance af7a49f1-361e-4684-9134-0ba52665297b on hv-cinder-84496 Jun 07 13:20:47.249216 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-6a8058ce-4a73-4b77-bc80-15b20390d902 req-93decfb9-511f-4987-abfc-26cb752403a5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031375 Jun 07 13:20:47.249802 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 452/898] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:47.448893 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-84d772bb-b2d3-44e2-859f-b1f41e00fd59 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:47.449510 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-84d772bb-b2d3-44e2-859f-b1f41e00fd59 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:47.456081 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-84d772bb-b2d3-44e2-859f-b1f41e00fd59 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:47.456530 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-84d772bb-b2d3-44e2-859f-b1f41e00fd59 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:47.457298 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-84d772bb-b2d3-44e2-859f-b1f41e00fd59 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:47.457739 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-84d772bb-b2d3-44e2-859f-b1f41e00fd59 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:47.592488 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-84d772bb-b2d3-44e2-859f-b1f41e00fd59 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:47.601095 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-84d772bb-b2d3-44e2-859f-b1f41e00fd59 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:47.602865 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-84d772bb-b2d3-44e2-859f-b1f41e00fd59 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:47.604349 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-84d772bb-b2d3-44e2-859f-b1f41e00fd59 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1407 microversion: 2.20 time: 0.159288 Jun 07 13:20:47.605009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 447/899] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:47 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:48.623304 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5437636a-8b52-4b39-a934-804145bc79b3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:48.624009 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5437636a-8b52-4b39-a934-804145bc79b3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:48.630976 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5437636a-8b52-4b39-a934-804145bc79b3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:48.631600 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5437636a-8b52-4b39-a934-804145bc79b3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:48.632155 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5437636a-8b52-4b39-a934-804145bc79b3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:48.632625 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5437636a-8b52-4b39-a934-804145bc79b3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:48.761024 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5437636a-8b52-4b39-a934-804145bc79b3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:48.769430 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5437636a-8b52-4b39-a934-804145bc79b3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:48.770954 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5437636a-8b52-4b39-a934-804145bc79b3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:48.772048 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5437636a-8b52-4b39-a934-804145bc79b3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1407 microversion: 2.20 time: 0.153084 Jun 07 13:20:48.772612 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 453/900] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:48 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:49.789587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f4e6d325-2840-46bf-a575-9db05486cc96 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:49.790200 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f4e6d325-2840-46bf-a575-9db05486cc96 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:49.792676 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=2 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:49.793459 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=6 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:49.800349 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f4e6d325-2840-46bf-a575-9db05486cc96 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:49.800802 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f4e6d325-2840-46bf-a575-9db05486cc96 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:49.801568 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f4e6d325-2840-46bf-a575-9db05486cc96 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:49.802007 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f4e6d325-2840-46bf-a575-9db05486cc96 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:49.927780 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f4e6d325-2840-46bf-a575-9db05486cc96 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:49.935598 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f4e6d325-2840-46bf-a575-9db05486cc96 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:49.937113 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f4e6d325-2840-46bf-a575-9db05486cc96 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:49.938195 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f4e6d325-2840-46bf-a575-9db05486cc96 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1407 microversion: 2.20 time: 0.152578 Jun 07 13:20:49.938788 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 448/901] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:49 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:50.955978 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a746e4eb-004d-4662-bd07-95f3e884b935 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:50.956617 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a746e4eb-004d-4662-bd07-95f3e884b935 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:50.958570 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:50.964379 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a746e4eb-004d-4662-bd07-95f3e884b935 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:50.964830 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a746e4eb-004d-4662-bd07-95f3e884b935 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:50.965599 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a746e4eb-004d-4662-bd07-95f3e884b935 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:50.966039 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a746e4eb-004d-4662-bd07-95f3e884b935 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:51.095085 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a746e4eb-004d-4662-bd07-95f3e884b935 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:51.103180 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a746e4eb-004d-4662-bd07-95f3e884b935 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:51.104684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a746e4eb-004d-4662-bd07-95f3e884b935 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:51.105833 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a746e4eb-004d-4662-bd07-95f3e884b935 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1599 microversion: 2.20 time: 0.153848 Jun 07 13:20:51.106387 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 454/902] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:50 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:51.123244 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7b57533a-b927-4dd5-8421-d71062118f1c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:51.123729 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7b57533a-b927-4dd5-8421-d71062118f1c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:51.131471 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7b57533a-b927-4dd5-8421-d71062118f1c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:51.131928 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7b57533a-b927-4dd5-8421-d71062118f1c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:51.132698 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7b57533a-b927-4dd5-8421-d71062118f1c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:51.133140 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7b57533a-b927-4dd5-8421-d71062118f1c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:51.210124 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-7b57533a-b927-4dd5-8421-d71062118f1c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090626 Jun 07 13:20:51.210761 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 449/903] 10.222.0.58 () {60 vars in 1315 bytes} [Tue Jun 7 13:20:51 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:20:52.282128 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-8d3578a2-fe6d-4a4a-b4ce-a64486306a77 req-83fd8420-ccdd-49f5-b021-9bbc86186748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7a49f1-361e-4684-9134-0ba52665297b", "tag": "5cbf5f8c-af01-4a2e-8f16-dd54822bb4cd"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:52.291070 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-8d3578a2-fe6d-4a4a-b4ce-a64486306a77 req-83fd8420-ccdd-49f5-b021-9bbc86186748 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:52.291626 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-8d3578a2-fe6d-4a4a-b4ce-a64486306a77 req-83fd8420-ccdd-49f5-b021-9bbc86186748 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:52.302731 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-8d3578a2-fe6d-4a4a-b4ce-a64486306a77 req-83fd8420-ccdd-49f5-b021-9bbc86186748 service nova] Creating event network-changed:5cbf5f8c-af01-4a2e-8f16-dd54822bb4cd for instance af7a49f1-361e-4684-9134-0ba52665297b on hv-cinder-84496 Jun 07 13:20:52.308988 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-8d3578a2-fe6d-4a4a-b4ce-a64486306a77 req-83fd8420-ccdd-49f5-b021-9bbc86186748 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030688 Jun 07 13:20:52.309744 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 455/904] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:52.597701 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f4c1bbdf-6e6a-4091-a950-33d698f71549 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:52.598330 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f4c1bbdf-6e6a-4091-a950-33d698f71549 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:52.605015 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f4c1bbdf-6e6a-4091-a950-33d698f71549 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:52.605671 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f4c1bbdf-6e6a-4091-a950-33d698f71549 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:52.606901 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f4c1bbdf-6e6a-4091-a950-33d698f71549 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:52.607346 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f4c1bbdf-6e6a-4091-a950-33d698f71549 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:52.693830 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-f4c1bbdf-6e6a-4091-a950-33d698f71549 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lazy-loading 'services' on Instance uuid bfc2b109-2c98-4fdc-b735-5df0ced46167 {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:20:52.777092 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f4c1bbdf-6e6a-4091-a950-33d698f71549 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-volume_attachments/a4fb002c-f95c-4bd5-bc3c-086a1b2d6d7b" status: 202 len: 0 microversion: 2.1 time: 0.184829 Jun 07 13:20:52.781421 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 450/905] 10.222.0.58 () {58 vars in 1415 bytes} [Tue Jun 7 13:20:52 2022] DELETE /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-volume_attachments/a4fb002c-f95c-4bd5-bc3c-086a1b2d6d7b => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:20:52.787505 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ee968a5e-9743-48d8-8a3e-e075dd812aaa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:52.794933 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ee968a5e-9743-48d8-8a3e-e075dd812aaa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:52.808510 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ee968a5e-9743-48d8-8a3e-e075dd812aaa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:52.808979 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ee968a5e-9743-48d8-8a3e-e075dd812aaa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:52.809797 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ee968a5e-9743-48d8-8a3e-e075dd812aaa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:52.811788 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ee968a5e-9743-48d8-8a3e-e075dd812aaa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:52.851433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ee968a5e-9743-48d8-8a3e-e075dd812aaa tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068562 Jun 07 13:20:52.852265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 456/906] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:20:52 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:53.865418 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b66e2b81-03b7-44fd-bc62-343fc80020f5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:53.866464 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b66e2b81-03b7-44fd-bc62-343fc80020f5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:53.872909 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b66e2b81-03b7-44fd-bc62-343fc80020f5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:53.873367 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b66e2b81-03b7-44fd-bc62-343fc80020f5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:53.874361 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b66e2b81-03b7-44fd-bc62-343fc80020f5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:53.875025 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b66e2b81-03b7-44fd-bc62-343fc80020f5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:53.908164 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b66e2b81-03b7-44fd-bc62-343fc80020f5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048502 Jun 07 13:20:53.908794 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 451/907] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:20:53 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:54.919878 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-622677e9-235a-468b-8241-b7feb842c69e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:54.920808 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-622677e9-235a-468b-8241-b7feb842c69e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:54.927258 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-622677e9-235a-468b-8241-b7feb842c69e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:54.927708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-622677e9-235a-468b-8241-b7feb842c69e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:54.928467 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-622677e9-235a-468b-8241-b7feb842c69e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:54.928903 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-622677e9-235a-468b-8241-b7feb842c69e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:54.957331 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-622677e9-235a-468b-8241-b7feb842c69e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041492 Jun 07 13:20:54.957881 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 457/908] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:20:54 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:20:55.026458 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0e69ee6c-ba95-4983-8ba8-4b3aee5d764d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:55.026979 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0e69ee6c-ba95-4983-8ba8-4b3aee5d764d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:55.033576 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0e69ee6c-ba95-4983-8ba8-4b3aee5d764d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:55.034050 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0e69ee6c-ba95-4983-8ba8-4b3aee5d764d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:55.034830 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0e69ee6c-ba95-4983-8ba8-4b3aee5d764d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:55.035268 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0e69ee6c-ba95-4983-8ba8-4b3aee5d764d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:55.059530 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0e69ee6c-ba95-4983-8ba8-4b3aee5d764d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Going to try to terminate instance {{(pid=117797) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:20:55.133387 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0e69ee6c-ba95-4983-8ba8-4b3aee5d764d tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 204 len: 0 microversion: 2.1 time: 0.110132 Jun 07 13:20:55.134175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 452/909] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:20:55 2022] DELETE /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:20:55.143193 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-42878091-a0ac-47ee-9191-ac1ac9ca3587 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:55.143841 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-42878091-a0ac-47ee-9191-ac1ac9ca3587 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:55.149977 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-42878091-a0ac-47ee-9191-ac1ac9ca3587 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:55.150412 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-42878091-a0ac-47ee-9191-ac1ac9ca3587 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:55.151350 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-42878091-a0ac-47ee-9191-ac1ac9ca3587 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:55.151799 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-42878091-a0ac-47ee-9191-ac1ac9ca3587 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:55.518377 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-42878091-a0ac-47ee-9191-ac1ac9ca3587 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:55.525742 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-42878091-a0ac-47ee-9191-ac1ac9ca3587 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1690 microversion: 2.1 time: 0.387142 Jun 07 13:20:55.526308 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 458/910] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:55 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1690 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:56.543457 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ab007eb7-df2b-4c81-8c6f-5cc27a5666dd tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:56.544152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ab007eb7-df2b-4c81-8c6f-5cc27a5666dd tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:56.550600 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ab007eb7-df2b-4c81-8c6f-5cc27a5666dd tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:56.551053 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ab007eb7-df2b-4c81-8c6f-5cc27a5666dd tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:56.551811 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ab007eb7-df2b-4c81-8c6f-5cc27a5666dd tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:56.552246 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ab007eb7-df2b-4c81-8c6f-5cc27a5666dd tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:56.680350 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ab007eb7-df2b-4c81-8c6f-5cc27a5666dd tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:56.687864 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ab007eb7-df2b-4c81-8c6f-5cc27a5666dd tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1690 microversion: 2.1 time: 0.148725 Jun 07 13:20:56.688437 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 453/911] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:56 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1690 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:57.704441 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c21f1748-f247-40ff-a102-81f6f93607ce tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:57.705062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c21f1748-f247-40ff-a102-81f6f93607ce tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:57.711558 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c21f1748-f247-40ff-a102-81f6f93607ce tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:57.712007 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c21f1748-f247-40ff-a102-81f6f93607ce tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:57.712769 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c21f1748-f247-40ff-a102-81f6f93607ce tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:57.713207 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c21f1748-f247-40ff-a102-81f6f93607ce tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:57.840032 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c21f1748-f247-40ff-a102-81f6f93607ce tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:57.847685 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c21f1748-f247-40ff-a102-81f6f93607ce tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1690 microversion: 2.1 time: 0.147197 Jun 07 13:20:57.848261 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 459/912] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:57 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:58.864341 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-4baf73df-6c1d-4411-ac3f-d68d119e26c6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:58.864953 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-4baf73df-6c1d-4411-ac3f-d68d119e26c6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:58.871595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4baf73df-6c1d-4411-ac3f-d68d119e26c6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:58.872043 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4baf73df-6c1d-4411-ac3f-d68d119e26c6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:58.872811 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4baf73df-6c1d-4411-ac3f-d68d119e26c6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:58.873249 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4baf73df-6c1d-4411-ac3f-d68d119e26c6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:58.998285 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-4baf73df-6c1d-4411-ac3f-d68d119e26c6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:59.006460 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-4baf73df-6c1d-4411-ac3f-d68d119e26c6 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1690 microversion: 2.1 time: 0.145991 Jun 07 13:20:59.007039 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 454/913] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:58 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1690 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:59.906151 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-6905fac4-54de-4856-8305-ae242c4b0051 req-111500c6-0cae-47f8-aebf-253e98521f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc2b109-2c98-4fdc-b735-5df0ced46167", "name": "network-vif-deleted", "tag": "3566a568-9f54-445c-8198-4bb46048ae8a"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:59.914894 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:59.924630 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-6905fac4-54de-4856-8305-ae242c4b0051 req-111500c6-0cae-47f8-aebf-253e98521f40 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:59.925085 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-6905fac4-54de-4856-8305-ae242c4b0051 req-111500c6-0cae-47f8-aebf-253e98521f40 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:59.944390 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-6905fac4-54de-4856-8305-ae242c4b0051 req-111500c6-0cae-47f8-aebf-253e98521f40 service nova] Creating event network-vif-deleted:3566a568-9f54-445c-8198-4bb46048ae8a for instance bfc2b109-2c98-4fdc-b735-5df0ced46167 on hv-cinder-84496 Jun 07 13:20:59.949631 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-6905fac4-54de-4856-8305-ae242c4b0051 req-111500c6-0cae-47f8-aebf-253e98521f40 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047699 Jun 07 13:20:59.950221 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 460/914] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:00.023267 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8007f63e-99df-4b75-aa27-bd87e0a4b0ea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:00.023878 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8007f63e-99df-4b75-aa27-bd87e0a4b0ea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:00.031481 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8007f63e-99df-4b75-aa27-bd87e0a4b0ea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:00.031936 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8007f63e-99df-4b75-aa27-bd87e0a4b0ea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:00.033273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8007f63e-99df-4b75-aa27-bd87e0a4b0ea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:00.033711 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8007f63e-99df-4b75-aa27-bd87e0a4b0ea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:00.072085 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8007f63e-99df-4b75-aa27-bd87e0a4b0ea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:00.072762 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8007f63e-99df-4b75-aa27-bd87e0a4b0ea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:00.073395 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-8007f63e-99df-4b75-aa27-bd87e0a4b0ea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lazy-loading 'fault' on Instance uuid bfc2b109-2c98-4fdc-b735-5df0ced46167 {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:21:00.077451 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:00.132120 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8007f63e-99df-4b75-aa27-bd87e0a4b0ea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:00.142567 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8007f63e-99df-4b75-aa27-bd87e0a4b0ea tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 200 len: 1336 microversion: 2.1 time: 0.122486 Jun 07 13:21:00.143741 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 455/915] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:00 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 1336 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:01.161667 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-80312cf5-39fc-43b4-9dc4-894c4226f3a0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:01.162361 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-80312cf5-39fc-43b4-9dc4-894c4226f3a0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: bfc2b109-2c98-4fdc-b735-5df0ced46167] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:01.168510 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-80312cf5-39fc-43b4-9dc4-894c4226f3a0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:01.168952 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-80312cf5-39fc-43b4-9dc4-894c4226f3a0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:01.169695 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-80312cf5-39fc-43b4-9dc4-894c4226f3a0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:01.170125 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-80312cf5-39fc-43b4-9dc4-894c4226f3a0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:01.172741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:01.185290 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-80312cf5-39fc-43b4-9dc4-894c4226f3a0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] HTTP exception thrown: Instance bfc2b109-2c98-4fdc-b735-5df0ced46167 could not be found. Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-80312cf5-39fc-43b4-9dc4-894c4226f3a0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Request method failure captured: Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 HTTP/1.1 Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08fnlwGehPX3-H_Kq_5YwJ5FQsJGwz2frHqKqQ67_UYrSxGEscucac9ZoVlVC7gMud81HUQ5J2_ZlZWeMNcFTo0gNE3uarIqwi2j_-TfEMEZhIE4hhTn76I3Uq5ux-8ZGE780Z7Fsn7Rqn9RqSQPPcytf_qpi5fnis_yDH40YQcQuc Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 562a790e14024341b71d99b5b56fdbfb Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-567307477 Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:21:01.186932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:21:01.188536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_562a790e14024341b71d99b5b56fdbfb", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/562a790e14024341b71d99b5b56fdbfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/562a790e14024341b71d99b5b56fdbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/562a790e14024341b71d99b5b56fdbfb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:21:01.188536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-ServerRescueNegativeTestJSON-567307477 Jun 07 13:21:01.188536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 562a790e14024341b71d99b5b56fdbfb Jun 07 13:21:01.188536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-567307477 Jun 07 13:21:01.188536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-ServerRescueNegativeTestJSON-567307477-project Jun 07 13:21:01.188536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:21:01.188536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:21:01.188536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 3f1820e65ba6475d95f5614a9e035019 Jun 07 13:21:01.188536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-ServerRescueNegativeTestJSON-567307477-project Jun 07 13:21:01.188536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:21:01.188536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance bfc2b109-2c98-4fdc-b735-5df0ced46167 could not be found. Jun 07 13:21:01.188536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': 'bfc2b109-2c98-4fdc-b735-5df0ced46167'} Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfc2b109-2c98-4fdc-b735-5df0ced46167 could not be found. Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:21:01.189382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfc2b109-2c98-4fdc-b735-5df0ced46167 could not be found. Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfc2b109-2c98-4fdc-b735-5df0ced46167 could not be found. Jun 07 13:21:01.190960 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:01.192283 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-80312cf5-39fc-43b4-9dc4-894c4226f3a0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Returning 404 to user: Instance bfc2b109-2c98-4fdc-b735-5df0ced46167 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:21:01.192283 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-80312cf5-39fc-43b4-9dc4-894c4226f3a0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167" status: 404 len: 111 microversion: 2.1 time: 0.032174 Jun 07 13:21:01.192283 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 461/916] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:01 2022] GET /compute/v2.1/servers/bfc2b109-2c98-4fdc-b735-5df0ced46167 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:21:01.196866 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e85fa982-21b3-425a-8167-62c8c58ac3eb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '.version_select at 0x7fb8f8f633a0>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:01.214386 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e85fa982-21b3-425a-8167-62c8c58ac3eb tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1291931883" status: 202 len: 0 microversion: 2.1 time: 0.021301 Jun 07 13:21:01.214958 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 456/917] 10.222.0.58 () {58 vars in 1220 bytes} [Tue Jun 7 13:21:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1291931883 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:21:04.045287 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2101a846-a609-4a98-9ade-5c2b005b0f96 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:04.045772 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2101a846-a609-4a98-9ade-5c2b005b0f96 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:04.053008 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2101a846-a609-4a98-9ade-5c2b005b0f96 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:04.053452 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2101a846-a609-4a98-9ade-5c2b005b0f96 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:04.054206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2101a846-a609-4a98-9ade-5c2b005b0f96 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:04.054672 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2101a846-a609-4a98-9ade-5c2b005b0f96 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:04.078846 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2101a846-a609-4a98-9ade-5c2b005b0f96 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:21:04.149744 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2101a846-a609-4a98-9ade-5c2b005b0f96 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 204 len: 0 microversion: 2.1 time: 0.108309 Jun 07 13:21:04.150284 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 462/918] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:21:04 2022] DELETE /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:21:04.159478 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c296e8cf-5c59-4beb-9e0a-8bde18bd9741 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:04.160078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c296e8cf-5c59-4beb-9e0a-8bde18bd9741 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:04.166142 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c296e8cf-5c59-4beb-9e0a-8bde18bd9741 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:04.166628 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c296e8cf-5c59-4beb-9e0a-8bde18bd9741 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:04.167381 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c296e8cf-5c59-4beb-9e0a-8bde18bd9741 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:04.167812 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c296e8cf-5c59-4beb-9e0a-8bde18bd9741 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:04.295786 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c296e8cf-5c59-4beb-9e0a-8bde18bd9741 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:04.303873 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c296e8cf-5c59-4beb-9e0a-8bde18bd9741 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1508 microversion: 2.1 time: 0.148821 Jun 07 13:21:04.304432 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 457/919] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:04 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:21:05.321841 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ae572ec9-24ee-4701-99ec-d1a16f8deea0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:05.322527 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ae572ec9-24ee-4701-99ec-d1a16f8deea0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:05.328978 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ae572ec9-24ee-4701-99ec-d1a16f8deea0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:05.329432 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ae572ec9-24ee-4701-99ec-d1a16f8deea0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:05.330192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ae572ec9-24ee-4701-99ec-d1a16f8deea0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:05.330661 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ae572ec9-24ee-4701-99ec-d1a16f8deea0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:05.457849 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ae572ec9-24ee-4701-99ec-d1a16f8deea0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:05.466013 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ae572ec9-24ee-4701-99ec-d1a16f8deea0 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1508 microversion: 2.1 time: 0.148350 Jun 07 13:21:05.466644 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 463/920] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:05 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:06.483621 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-2b039d6d-3a8e-4943-ac51-9d9bca96e90f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:06.484232 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-2b039d6d-3a8e-4943-ac51-9d9bca96e90f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:06.490621 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2b039d6d-3a8e-4943-ac51-9d9bca96e90f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:06.491068 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2b039d6d-3a8e-4943-ac51-9d9bca96e90f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:06.491822 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2b039d6d-3a8e-4943-ac51-9d9bca96e90f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:06.492250 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2b039d6d-3a8e-4943-ac51-9d9bca96e90f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:06.626068 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-2b039d6d-3a8e-4943-ac51-9d9bca96e90f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:06.635128 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-2b039d6d-3a8e-4943-ac51-9d9bca96e90f tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 200 len: 1508 microversion: 2.1 time: 0.155316 Jun 07 13:21:06.645049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 458/921] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:06 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:06.692142 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-71588886-69c4-4449-bda9-1c9bc19584fd req-0562a806-c71a-4400-859d-a2ae37e221d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0925b3-d41e-4935-abb7-e3566d134f26", "name": "network-vif-deleted", "tag": "2fe156ca-e8ed-44a1-9a93-c8bcc91216e2"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:06.702433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-71588886-69c4-4449-bda9-1c9bc19584fd req-0562a806-c71a-4400-859d-a2ae37e221d9 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:06.702906 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-71588886-69c4-4449-bda9-1c9bc19584fd req-0562a806-c71a-4400-859d-a2ae37e221d9 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:06.714024 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-71588886-69c4-4449-bda9-1c9bc19584fd req-0562a806-c71a-4400-859d-a2ae37e221d9 service nova] Creating event network-vif-deleted:2fe156ca-e8ed-44a1-9a93-c8bcc91216e2 for instance 8d0925b3-d41e-4935-abb7-e3566d134f26 on hv-cinder-84496 Jun 07 13:21:06.719290 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-71588886-69c4-4449-bda9-1c9bc19584fd req-0562a806-c71a-4400-859d-a2ae37e221d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031230 Jun 07 13:21:06.720336 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 464/922] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:07.652636 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-27845a02-17d9-4480-92a8-f8e9f346cbd9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:07.653493 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-27845a02-17d9-4480-92a8-f8e9f346cbd9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 8d0925b3-d41e-4935-abb7-e3566d134f26] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:07.660598 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-27845a02-17d9-4480-92a8-f8e9f346cbd9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:07.661048 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-27845a02-17d9-4480-92a8-f8e9f346cbd9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:07.662189 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-27845a02-17d9-4480-92a8-f8e9f346cbd9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:07.662659 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-27845a02-17d9-4480-92a8-f8e9f346cbd9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:07.676886 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-27845a02-17d9-4480-92a8-f8e9f346cbd9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] HTTP exception thrown: Instance 8d0925b3-d41e-4935-abb7-e3566d134f26 could not be found. Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-27845a02-17d9-4480-92a8-f8e9f346cbd9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Request method failure captured: Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 HTTP/1.1 Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08fnlwGehPX3-H_Kq_5YwJ5FQsJGwz2frHqKqQ67_UYrSxGEscucac9ZoVlVC7gMud81HUQ5J2_ZlZWeMNcFTo0gNE3uarIqwi2j_-TfEMEZhIE4hhTn76I3Uq5ux-8ZGE780Z7Fsn7Rqn9RqSQPPcytf_qpi5fnis_yDH40YQcQuc Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 562a790e14024341b71d99b5b56fdbfb Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-567307477 Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:21:07.678544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:21:07.680133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_562a790e14024341b71d99b5b56fdbfb", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/562a790e14024341b71d99b5b56fdbfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/562a790e14024341b71d99b5b56fdbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/562a790e14024341b71d99b5b56fdbfb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:21:07.680133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-ServerRescueNegativeTestJSON-567307477 Jun 07 13:21:07.680133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 562a790e14024341b71d99b5b56fdbfb Jun 07 13:21:07.680133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-567307477 Jun 07 13:21:07.680133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-ServerRescueNegativeTestJSON-567307477-project Jun 07 13:21:07.680133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:21:07.680133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:21:07.680133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 3f1820e65ba6475d95f5614a9e035019 Jun 07 13:21:07.680133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-ServerRescueNegativeTestJSON-567307477-project Jun 07 13:21:07.680133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:21:07.680133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance 8d0925b3-d41e-4935-abb7-e3566d134f26 could not be found. Jun 07 13:21:07.680133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': '8d0925b3-d41e-4935-abb7-e3566d134f26'} Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d0925b3-d41e-4935-abb7-e3566d134f26 could not be found. Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:21:07.680967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d0925b3-d41e-4935-abb7-e3566d134f26 could not be found. Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d0925b3-d41e-4935-abb7-e3566d134f26 could not be found. Jun 07 13:21:07.682504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:21:07.683947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-27845a02-17d9-4480-92a8-f8e9f346cbd9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Returning 404 to user: Instance 8d0925b3-d41e-4935-abb7-e3566d134f26 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:21:07.683947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-27845a02-17d9-4480-92a8-f8e9f346cbd9 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26" status: 404 len: 111 microversion: 2.1 time: 0.031174 Jun 07 13:21:07.683947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 459/923] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:07 2022] GET /compute/v2.1/servers/8d0925b3-d41e-4935-abb7-e3566d134f26 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:21:07.688814 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-71b4ab39-4d3d-4947-8ec4-50ef6b4c5f91 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:07.689397 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-71b4ab39-4d3d-4947-8ec4-50ef6b4c5f91 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:07.696066 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-71b4ab39-4d3d-4947-8ec4-50ef6b4c5f91 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:07.696651 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-71b4ab39-4d3d-4947-8ec4-50ef6b4c5f91 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:07.697248 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-71b4ab39-4d3d-4947-8ec4-50ef6b4c5f91 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:07.697681 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-71b4ab39-4d3d-4947-8ec4-50ef6b4c5f91 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:07.722532 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-71b4ab39-4d3d-4947-8ec4-50ef6b4c5f91 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:21:07.794361 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-71b4ab39-4d3d-4947-8ec4-50ef6b4c5f91 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "DELETE /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 204 len: 0 microversion: 2.1 time: 0.109417 Jun 07 13:21:07.795222 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 465/924] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:21:07 2022] DELETE /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:21:07.804528 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f2309828-5e24-4cc7-8413-48265893b324 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:07.805147 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f2309828-5e24-4cc7-8413-48265893b324 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:07.811139 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f2309828-5e24-4cc7-8413-48265893b324 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:07.811592 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f2309828-5e24-4cc7-8413-48265893b324 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:07.812350 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f2309828-5e24-4cc7-8413-48265893b324 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:07.812790 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f2309828-5e24-4cc7-8413-48265893b324 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:07.937934 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f2309828-5e24-4cc7-8413-48265893b324 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:07.945876 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f2309828-5e24-4cc7-8413-48265893b324 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.145813 Jun 07 13:21:07.946462 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 460/925] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:07 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:08.963733 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-896a02d6-c60c-4cbe-99b9-ed25de1bf6a1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:08.964424 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-896a02d6-c60c-4cbe-99b9-ed25de1bf6a1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:08.971380 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-896a02d6-c60c-4cbe-99b9-ed25de1bf6a1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:08.971827 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-896a02d6-c60c-4cbe-99b9-ed25de1bf6a1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:08.972584 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-896a02d6-c60c-4cbe-99b9-ed25de1bf6a1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:08.973039 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-896a02d6-c60c-4cbe-99b9-ed25de1bf6a1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:09.103544 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-896a02d6-c60c-4cbe-99b9-ed25de1bf6a1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:09.110959 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-896a02d6-c60c-4cbe-99b9-ed25de1bf6a1 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.151393 Jun 07 13:21:09.111526 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 466/926] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:08 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:10.128033 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-613ef773-5bbc-4418-8ae6-b95e6c24226e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:10.128565 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-613ef773-5bbc-4418-8ae6-b95e6c24226e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:10.135261 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-613ef773-5bbc-4418-8ae6-b95e6c24226e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:10.135715 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-613ef773-5bbc-4418-8ae6-b95e6c24226e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:10.136481 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-613ef773-5bbc-4418-8ae6-b95e6c24226e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:10.136918 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-613ef773-5bbc-4418-8ae6-b95e6c24226e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:10.267300 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-613ef773-5bbc-4418-8ae6-b95e6c24226e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:10.275588 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-613ef773-5bbc-4418-8ae6-b95e6c24226e tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1521 microversion: 2.1 time: 0.151483 Jun 07 13:21:10.276153 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 461/927] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:10 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:11.124762 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-d51f909c-92e3-49d7-9021-e1427d85d8ce req-0dd5ad9e-edbd-414f-ba39-5e705d3d50ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972b9306-4700-4212-ba99-0654d90e4348", "name": "network-vif-deleted", "tag": "46af4bbe-8074-4168-ad35-f13ba7b7a236"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:11.133858 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d51f909c-92e3-49d7-9021-e1427d85d8ce req-0dd5ad9e-edbd-414f-ba39-5e705d3d50ca service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:11.134297 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d51f909c-92e3-49d7-9021-e1427d85d8ce req-0dd5ad9e-edbd-414f-ba39-5e705d3d50ca service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:11.144808 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-d51f909c-92e3-49d7-9021-e1427d85d8ce req-0dd5ad9e-edbd-414f-ba39-5e705d3d50ca service nova] Creating event network-vif-deleted:46af4bbe-8074-4168-ad35-f13ba7b7a236 for instance 972b9306-4700-4212-ba99-0654d90e4348 on hv-cinder-84496 Jun 07 13:21:11.149392 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-d51f909c-92e3-49d7-9021-e1427d85d8ce req-0dd5ad9e-edbd-414f-ba39-5e705d3d50ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028342 Jun 07 13:21:11.149957 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 467/928] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:11.292314 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-09dd5c89-9849-46a4-a1a1-33cba1f3e6e5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:11.292885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-09dd5c89-9849-46a4-a1a1-33cba1f3e6e5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:11.295150 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:11.301127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-09dd5c89-9849-46a4-a1a1-33cba1f3e6e5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:11.301589 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-09dd5c89-9849-46a4-a1a1-33cba1f3e6e5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:11.302424 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-09dd5c89-9849-46a4-a1a1-33cba1f3e6e5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:11.302935 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-09dd5c89-9849-46a4-a1a1-33cba1f3e6e5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:11.335383 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-09dd5c89-9849-46a4-a1a1-33cba1f3e6e5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:11.335761 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-09dd5c89-9849-46a4-a1a1-33cba1f3e6e5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:11.336209 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-09dd5c89-9849-46a4-a1a1-33cba1f3e6e5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lazy-loading 'fault' on Instance uuid 972b9306-4700-4212-ba99-0654d90e4348 {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:21:11.375779 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-09dd5c89-9849-46a4-a1a1-33cba1f3e6e5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1820e65ba6475d95f5614a9e035019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '562a790e14024341b71d99b5b56fdbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:11.383879 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-09dd5c89-9849-46a4-a1a1-33cba1f3e6e5 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 200 len: 1311 microversion: 2.1 time: 0.095541 Jun 07 13:21:11.384532 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 462/929] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:11 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:12.401528 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bf08be76-6851-478f-900d-fe1b1eb49889 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:12.402246 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bf08be76-6851-478f-900d-fe1b1eb49889 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] [instance: 972b9306-4700-4212-ba99-0654d90e4348] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:12.409086 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf08be76-6851-478f-900d-fe1b1eb49889 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:12.409528 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf08be76-6851-478f-900d-fe1b1eb49889 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:12.410277 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf08be76-6851-478f-900d-fe1b1eb49889 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:12.410734 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf08be76-6851-478f-900d-fe1b1eb49889 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:12.423466 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-bf08be76-6851-478f-900d-fe1b1eb49889 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] HTTP exception thrown: Instance 972b9306-4700-4212-ba99-0654d90e4348 could not be found. Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bf08be76-6851-478f-900d-fe1b1eb49889 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Request method failure captured: Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 HTTP/1.1 Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08fnlwGehPX3-H_Kq_5YwJ5FQsJGwz2frHqKqQ67_UYrSxGEscucac9ZoVlVC7gMud81HUQ5J2_ZlZWeMNcFTo0gNE3uarIqwi2j_-TfEMEZhIE4hhTn76I3Uq5ux-8ZGE780Z7Fsn7Rqn9RqSQPPcytf_qpi5fnis_yDH40YQcQuc Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 562a790e14024341b71d99b5b56fdbfb Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-567307477 Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:21:12.425697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:21:12.427254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_562a790e14024341b71d99b5b56fdbfb", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/562a790e14024341b71d99b5b56fdbfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/562a790e14024341b71d99b5b56fdbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/562a790e14024341b71d99b5b56fdbfb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:21:12.427254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-ServerRescueNegativeTestJSON-567307477 Jun 07 13:21:12.427254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 562a790e14024341b71d99b5b56fdbfb Jun 07 13:21:12.427254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-567307477 Jun 07 13:21:12.427254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-ServerRescueNegativeTestJSON-567307477-project Jun 07 13:21:12.427254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:21:12.427254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:21:12.427254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 3f1820e65ba6475d95f5614a9e035019 Jun 07 13:21:12.427254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-ServerRescueNegativeTestJSON-567307477-project Jun 07 13:21:12.427254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:21:12.427254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance 972b9306-4700-4212-ba99-0654d90e4348 could not be found. Jun 07 13:21:12.427254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': '972b9306-4700-4212-ba99-0654d90e4348'} Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972b9306-4700-4212-ba99-0654d90e4348 could not be found. Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:21:12.428115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972b9306-4700-4212-ba99-0654d90e4348 could not be found. Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972b9306-4700-4212-ba99-0654d90e4348 could not be found. Jun 07 13:21:12.429556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:12.430945 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bf08be76-6851-478f-900d-fe1b1eb49889 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] Returning 404 to user: Instance 972b9306-4700-4212-ba99-0654d90e4348 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:21:12.430945 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bf08be76-6851-478f-900d-fe1b1eb49889 tempest-ServerRescueNegativeTestJSON-567307477 tempest-ServerRescueNegativeTestJSON-567307477-project] 10.222.0.58 "GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348" status: 404 len: 111 microversion: 2.1 time: 0.030307 Jun 07 13:21:12.430945 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 468/930] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:12 2022] GET /compute/v2.1/servers/972b9306-4700-4212-ba99-0654d90e4348 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:21:13.240068 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-bca6f9dc-7b11-49ca-ba54-30ed381fb381 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:13.241064 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-bca6f9dc-7b11-49ca-ba54-30ed381fb381 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:13.247499 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bca6f9dc-7b11-49ca-ba54-30ed381fb381 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.247954 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bca6f9dc-7b11-49ca-ba54-30ed381fb381 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.248729 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bca6f9dc-7b11-49ca-ba54-30ed381fb381 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.249167 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bca6f9dc-7b11-49ca-ba54-30ed381fb381 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.280811 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-bca6f9dc-7b11-49ca-ba54-30ed381fb381 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044718 Jun 07 13:21:13.281454 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 463/931] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:21:13 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:21:13.341474 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-18f4821c-a69a-4059-857e-217b62e85696 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:13.341969 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-18f4821c-a69a-4059-857e-217b62e85696 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:13.348085 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-18f4821c-a69a-4059-857e-217b62e85696 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.348520 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-18f4821c-a69a-4059-857e-217b62e85696 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.349283 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-18f4821c-a69a-4059-857e-217b62e85696 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.349726 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-18f4821c-a69a-4059-857e-217b62e85696 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.376536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-18f4821c-a69a-4059-857e-217b62e85696 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:21:13.463281 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-18f4821c-a69a-4059-857e-217b62e85696 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 204 len: 0 microversion: 2.1 time: 0.125176 Jun 07 13:21:13.467730 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 469/932] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:21:13 2022] DELETE /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:21:13.472569 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-631a3376-b9d5-4c87-b7a5-4ed2f7767fd5 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:13.473274 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-631a3376-b9d5-4c87-b7a5-4ed2f7767fd5 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:13.479971 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-631a3376-b9d5-4c87-b7a5-4ed2f7767fd5 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.480420 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-631a3376-b9d5-4c87-b7a5-4ed2f7767fd5 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.481183 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-631a3376-b9d5-4c87-b7a5-4ed2f7767fd5 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.481615 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-631a3376-b9d5-4c87-b7a5-4ed2f7767fd5 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.714465 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-631a3376-b9d5-4c87-b7a5-4ed2f7767fd5 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:13.722626 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-631a3376-b9d5-4c87-b7a5-4ed2f7767fd5 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1675 microversion: 2.1 time: 0.253883 Jun 07 13:21:13.723187 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 464/933] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:13 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1675 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:14.747455 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f1f1ed7c-0356-4530-9cdb-f9eb0a1a6066 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:14.748164 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f1f1ed7c-0356-4530-9cdb-f9eb0a1a6066 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:14.755852 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f1f1ed7c-0356-4530-9cdb-f9eb0a1a6066 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:14.756380 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f1f1ed7c-0356-4530-9cdb-f9eb0a1a6066 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:14.757243 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f1f1ed7c-0356-4530-9cdb-f9eb0a1a6066 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:14.757753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f1f1ed7c-0356-4530-9cdb-f9eb0a1a6066 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:14.892516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f1f1ed7c-0356-4530-9cdb-f9eb0a1a6066 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:14.900047 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f1f1ed7c-0356-4530-9cdb-f9eb0a1a6066 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1675 microversion: 2.1 time: 0.164111 Jun 07 13:21:14.900625 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 470/934] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:14 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:15.918255 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-67015c83-921c-4186-bdfe-c499b84a3b75 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:15.919072 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-67015c83-921c-4186-bdfe-c499b84a3b75 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:15.932381 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-67015c83-921c-4186-bdfe-c499b84a3b75 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:15.932842 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-67015c83-921c-4186-bdfe-c499b84a3b75 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:15.935643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-67015c83-921c-4186-bdfe-c499b84a3b75 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:15.937948 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-67015c83-921c-4186-bdfe-c499b84a3b75 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:16.019786 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-67015c83-921c-4186-bdfe-c499b84a3b75 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:16.037919 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-67015c83-921c-4186-bdfe-c499b84a3b75 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 200 len: 1607 microversion: 2.1 time: 0.114924 Jun 07 13:21:16.039501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 465/935] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:15 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 1607 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:16.103701 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-ab4b3689-8f58-4eec-ae96-5f67804b8520 req-fe80a6b7-537f-43dd-bf7e-daaf1f038014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec72c48-4900-4d75-8fca-c5b6f5a287ca", "name": "network-vif-deleted", "tag": "58128dcd-c6cf-4bd6-852b-7f5930478fbf"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:16.120463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-ab4b3689-8f58-4eec-ae96-5f67804b8520 req-fe80a6b7-537f-43dd-bf7e-daaf1f038014 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:16.121113 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-ab4b3689-8f58-4eec-ae96-5f67804b8520 req-fe80a6b7-537f-43dd-bf7e-daaf1f038014 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:16.137457 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-ab4b3689-8f58-4eec-ae96-5f67804b8520 req-fe80a6b7-537f-43dd-bf7e-daaf1f038014 service nova] Creating event network-vif-deleted:58128dcd-c6cf-4bd6-852b-7f5930478fbf for instance dec72c48-4900-4d75-8fca-c5b6f5a287ca on hv-cinder-84496 Jun 07 13:21:16.145823 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-ab4b3689-8f58-4eec-ae96-5f67804b8520 req-fe80a6b7-537f-43dd-bf7e-daaf1f038014 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051443 Jun 07 13:21:16.146754 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 471/936] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:17.054875 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-096fe182-32e4-446d-9377-a56f16e16a60 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:17.056117 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-096fe182-32e4-446d-9377-a56f16e16a60 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:17.062979 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-096fe182-32e4-446d-9377-a56f16e16a60 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:17.063436 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-096fe182-32e4-446d-9377-a56f16e16a60 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:17.064755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-096fe182-32e4-446d-9377-a56f16e16a60 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:17.065202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-096fe182-32e4-446d-9377-a56f16e16a60 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:17.079634 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-096fe182-32e4-446d-9377-a56f16e16a60 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] HTTP exception thrown: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-096fe182-32e4-446d-9377-a56f16e16a60 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Request method failure captured: Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca HTTP/1.1 Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08bsYO-BvBobA841eqMlyF3MFUEu4iP30pVur_VBb2tT4Ia_nfGelqxEaCrgyJ84Z3DC7fic-hUg0YehCxIg4YXd4XPxDGrg6mHPq77spHg3NchTTTEPU1_Ch2_ataADNmKBOvdUv5UhQPVUchzg4BWB0XV6W2miEeaJil88m3nMQo Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 42e8fd59ba6046ad9185164e19c0be0f Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:21:17.081908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:21:17.088078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_42e8fd59ba6046ad9185164e19c0be0f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:21:17.088078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:21:17.088078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 42e8fd59ba6046ad9185164e19c0be0f Jun 07 13:21:17.088078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:21:17.088078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-AttachVolumeTestJSON-1780116012-project Jun 07 13:21:17.088078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:21:17.088078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:21:17.088078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 40a46709afbe46cbb93f6e2a1760d0c5 Jun 07 13:21:17.088078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-AttachVolumeTestJSON-1780116012-project Jun 07 13:21:17.088078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:21:17.088078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. Jun 07 13:21:17.088078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': 'dec72c48-4900-4d75-8fca-c5b6f5a287ca'} Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:21:17.088965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. Jun 07 13:21:17.090938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:21:17.092211 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-096fe182-32e4-446d-9377-a56f16e16a60 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Returning 404 to user: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:21:17.092211 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-096fe182-32e4-446d-9377-a56f16e16a60 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 404 len: 111 microversion: 2.1 time: 0.032416 Jun 07 13:21:17.092211 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 466/937] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:17 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:21:17.098338 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-86733d4e-48d1-492b-9352-c82bffe424dc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '.version_select at 0x7fb8f9107280>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:17.120220 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-86733d4e-48d1-492b-9352-c82bffe424dc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105419996" status: 202 len: 0 microversion: 2.1 time: 0.031577 Jun 07 13:21:17.121471 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 472/938] 10.222.0.58 () {58 vars in 1220 bytes} [Tue Jun 7 13:21:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105419996 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:21:17.784777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1d891151-42af-4fff-9b5a-5729f01ddc75 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Action: 'create', calling method: .version_select at 0x7fb8f4aac280>, body: {"keypair": {"name": "tempest-keypair-1077558605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvvUyhJj8C0xe899avfp8rfrPrOYOVeIwgJcwYDV63NWbxaOUP9lwBZB4XTRIkKB/Ix0/eLD9iXDMA9oIon/GCBOW1f/XrsGFUyjueNQoFBRIGAhbSzp6KSCfLyZmCv+g=="}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:17.799195 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-1d891151-42af-4fff-9b5a-5729f01ddc75 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Getting quotas for project 42e8fd59ba6046ad9185164e19c0be0f. Resources: {'key_pairs'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:21:17.803045 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-1d891151-42af-4fff-9b5a-5729f01ddc75 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Getting quotas for user 40a46709afbe46cbb93f6e2a1760d0c5 and project 42e8fd59ba6046ad9185164e19c0be0f. Resources: {'key_pairs'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:21:17.825090 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1d891151-42af-4fff-9b5a-5729f01ddc75 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044660 Jun 07 13:21:17.825679 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 467/939] 10.222.0.58 () {60 vars in 1158 bytes} [Tue Jun 7 13:21:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:19.357325 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c05d37fc-4939-4d2f-9676-a18261081d82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1121164317", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e959e3ea-2acf-4707-8260-cf27b3e4b096"}], "security_groups": [{"name": "tempest-securitygroup--835903088"}], "key_name": "tempest-keypair-1077558605", "user_data": "}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:19.458101 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-c05d37fc-4939-4d2f-9676-a18261081d82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] validate_networks() for [('e959e3ea-2acf-4707-8260-cf27b3e4b096', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:21:19.824090 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-c05d37fc-4939-4d2f-9676-a18261081d82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:21:19.825329 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-c05d37fc-4939-4d2f-9676-a18261081d82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:21:19.826930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-c05d37fc-4939-4d2f-9676-a18261081d82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:21:19.828432 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-c05d37fc-4939-4d2f-9676-a18261081d82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:21:19.829124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-c05d37fc-4939-4d2f-9676-a18261081d82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:21:19.838608 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c05d37fc-4939-4d2f-9676-a18261081d82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:19.839057 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c05d37fc-4939-4d2f-9676-a18261081d82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:19.839844 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c05d37fc-4939-4d2f-9676-a18261081d82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:19.840279 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c05d37fc-4939-4d2f-9676-a18261081d82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:19.857980 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-c05d37fc-4939-4d2f-9676-a18261081d82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Getting quotas for project 42e8fd59ba6046ad9185164e19c0be0f. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:21:19.862665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-c05d37fc-4939-4d2f-9676-a18261081d82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Getting quotas for user 40a46709afbe46cbb93f6e2a1760d0c5 and project 42e8fd59ba6046ad9185164e19c0be0f. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:21:19.873485 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c05d37fc-4939-4d2f-9676-a18261081d82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:21:19.875862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c05d37fc-4939-4d2f-9676-a18261081d82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:21:19.926608 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c05d37fc-4939-4d2f-9676-a18261081d82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.573503 Jun 07 13:21:19.932272 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 473/940] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:21:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 13:21:19.937786 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-67f67af4-38ba-4e51-8617-d2321e0eac2a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:19.938418 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-67f67af4-38ba-4e51-8617-d2321e0eac2a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:20.004496 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-67f67af4-38ba-4e51-8617-d2321e0eac2a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:20.016400 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-67f67af4-38ba-4e51-8617-d2321e0eac2a tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1238 microversion: 2.1 time: 0.082722 Jun 07 13:21:20.017025 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 468/941] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:19 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:21.038267 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d5bbf3f9-f40f-4364-9a33-9178ed3a1806 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:21.039647 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d5bbf3f9-f40f-4364-9a33-9178ed3a1806 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:21.047425 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d5bbf3f9-f40f-4364-9a33-9178ed3a1806 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:21.048026 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d5bbf3f9-f40f-4364-9a33-9178ed3a1806 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:21.048937 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d5bbf3f9-f40f-4364-9a33-9178ed3a1806 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:21.049550 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d5bbf3f9-f40f-4364-9a33-9178ed3a1806 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:21.128763 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d5bbf3f9-f40f-4364-9a33-9178ed3a1806 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:21.136134 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d5bbf3f9-f40f-4364-9a33-9178ed3a1806 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1296 microversion: 2.1 time: 0.102280 Jun 07 13:21:21.136693 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 474/942] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:21 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1296 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:22.153384 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9e7c25e2-df7c-4d65-8805-71a283a29341 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:22.154340 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9e7c25e2-df7c-4d65-8805-71a283a29341 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:22.163055 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e7c25e2-df7c-4d65-8805-71a283a29341 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:22.163746 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e7c25e2-df7c-4d65-8805-71a283a29341 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:22.164792 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e7c25e2-df7c-4d65-8805-71a283a29341 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:22.165301 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e7c25e2-df7c-4d65-8805-71a283a29341 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:22.305977 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9e7c25e2-df7c-4d65-8805-71a283a29341 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:22.313389 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9e7c25e2-df7c-4d65-8805-71a283a29341 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1363 microversion: 2.1 time: 0.164232 Jun 07 13:21:22.314004 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 469/943] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:22 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:22.631678 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-c90a71c9-3e33-4b37-a441-e34bb5336987 req-ffa8a26f-0157-448c-ae6b-874fd891df99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e529399b-e8ad-4d23-8b5d-6d6633ebf04c", "tag": "ad86f27e-afe4-4ff9-854c-46f40fe5246c"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:22.647238 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-c90a71c9-3e33-4b37-a441-e34bb5336987 req-ffa8a26f-0157-448c-ae6b-874fd891df99 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:22.647908 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-c90a71c9-3e33-4b37-a441-e34bb5336987 req-ffa8a26f-0157-448c-ae6b-874fd891df99 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:22.680566 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-c90a71c9-3e33-4b37-a441-e34bb5336987 req-ffa8a26f-0157-448c-ae6b-874fd891df99 service nova] Creating event network-changed:ad86f27e-afe4-4ff9-854c-46f40fe5246c for instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c on hv-cinder-84496 Jun 07 13:21:22.691603 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-c90a71c9-3e33-4b37-a441-e34bb5336987 req-ffa8a26f-0157-448c-ae6b-874fd891df99 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063714 Jun 07 13:21:22.692658 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 475/944] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:23.328924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ea040004-0aa8-47bf-8862-a8c2c05e5a48 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:23.329624 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ea040004-0aa8-47bf-8862-a8c2c05e5a48 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:23.336327 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ea040004-0aa8-47bf-8862-a8c2c05e5a48 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:23.336783 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ea040004-0aa8-47bf-8862-a8c2c05e5a48 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:23.337557 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ea040004-0aa8-47bf-8862-a8c2c05e5a48 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:23.337997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ea040004-0aa8-47bf-8862-a8c2c05e5a48 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:23.472827 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ea040004-0aa8-47bf-8862-a8c2c05e5a48 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:23.480355 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ea040004-0aa8-47bf-8862-a8c2c05e5a48 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1363 microversion: 2.1 time: 0.155221 Jun 07 13:21:23.481051 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 470/945] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:23 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:24.497971 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-aed5688a-01fb-4666-8a16-0c296489a49d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:24.498711 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-aed5688a-01fb-4666-8a16-0c296489a49d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:24.505311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aed5688a-01fb-4666-8a16-0c296489a49d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:24.505798 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aed5688a-01fb-4666-8a16-0c296489a49d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:24.506598 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aed5688a-01fb-4666-8a16-0c296489a49d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:24.507038 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aed5688a-01fb-4666-8a16-0c296489a49d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:24.637400 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-aed5688a-01fb-4666-8a16-0c296489a49d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:24.644897 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-aed5688a-01fb-4666-8a16-0c296489a49d tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1363 microversion: 2.1 time: 0.151577 Jun 07 13:21:24.645461 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 476/946] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:24 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:25.661630 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-eb9b1bbe-821a-423c-aea6-c5f1c36dfd27 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:25.662323 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-eb9b1bbe-821a-423c-aea6-c5f1c36dfd27 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:25.669104 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-eb9b1bbe-821a-423c-aea6-c5f1c36dfd27 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:25.669638 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-eb9b1bbe-821a-423c-aea6-c5f1c36dfd27 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:25.670703 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-eb9b1bbe-821a-423c-aea6-c5f1c36dfd27 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:25.671098 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-eb9b1bbe-821a-423c-aea6-c5f1c36dfd27 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:25.816510 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-eb9b1bbe-821a-423c-aea6-c5f1c36dfd27 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:25.824038 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-eb9b1bbe-821a-423c-aea6-c5f1c36dfd27 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1363 microversion: 2.1 time: 0.166763 Jun 07 13:21:25.824877 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 471/947] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:25 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:26.847562 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-830686a9-0cdb-41c9-857f-c07433105299 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:26.847562 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-830686a9-0cdb-41c9-857f-c07433105299 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:26.848856 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-830686a9-0cdb-41c9-857f-c07433105299 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:26.849311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-830686a9-0cdb-41c9-857f-c07433105299 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:26.850086 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-830686a9-0cdb-41c9-857f-c07433105299 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:26.850605 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-830686a9-0cdb-41c9-857f-c07433105299 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:26.992964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-830686a9-0cdb-41c9-857f-c07433105299 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:27.000266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-830686a9-0cdb-41c9-857f-c07433105299 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1363 microversion: 2.1 time: 0.163155 Jun 07 13:21:27.000824 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 477/948] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:26 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:28.017622 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-bb96a86b-4758-4de9-b230-f9cfce6ceebe tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:28.018381 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-bb96a86b-4758-4de9-b230-f9cfce6ceebe tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:28.024870 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bb96a86b-4758-4de9-b230-f9cfce6ceebe tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:28.025323 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bb96a86b-4758-4de9-b230-f9cfce6ceebe tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:28.026094 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bb96a86b-4758-4de9-b230-f9cfce6ceebe tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:28.026557 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bb96a86b-4758-4de9-b230-f9cfce6ceebe tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:28.158239 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-bb96a86b-4758-4de9-b230-f9cfce6ceebe tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:28.166213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-bb96a86b-4758-4de9-b230-f9cfce6ceebe tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1363 microversion: 2.1 time: 0.153053 Jun 07 13:21:28.166815 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 472/949] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:28 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:29.183113 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-dc14ba6d-2898-406a-8d3e-c785c769c5a3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:29.183648 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-dc14ba6d-2898-406a-8d3e-c785c769c5a3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:29.190407 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc14ba6d-2898-406a-8d3e-c785c769c5a3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:29.190983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc14ba6d-2898-406a-8d3e-c785c769c5a3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:29.191758 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc14ba6d-2898-406a-8d3e-c785c769c5a3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:29.192205 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc14ba6d-2898-406a-8d3e-c785c769c5a3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:29.207290 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:29.326755 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-dc14ba6d-2898-406a-8d3e-c785c769c5a3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:29.334773 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-dc14ba6d-2898-406a-8d3e-c785c769c5a3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1363 microversion: 2.1 time: 0.155550 Jun 07 13:21:29.335361 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 478/950] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:29 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:29.421818 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-1f0b222f-e175-488c-900a-acff619f24fd req-d76de92c-45b2-40c3-b658-064af0405b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e529399b-e8ad-4d23-8b5d-6d6633ebf04c", "name": "network-vif-plugged", "status": "completed", "tag": "ad86f27e-afe4-4ff9-854c-46f40fe5246c"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:29.430286 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-1f0b222f-e175-488c-900a-acff619f24fd req-d76de92c-45b2-40c3-b658-064af0405b38 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:29.430757 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-1f0b222f-e175-488c-900a-acff619f24fd req-d76de92c-45b2-40c3-b658-064af0405b38 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:29.442921 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-1f0b222f-e175-488c-900a-acff619f24fd req-d76de92c-45b2-40c3-b658-064af0405b38 service nova] Creating event network-vif-plugged:ad86f27e-afe4-4ff9-854c-46f40fe5246c for instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c on hv-cinder-84496 Jun 07 13:21:29.447780 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-1f0b222f-e175-488c-900a-acff619f24fd req-d76de92c-45b2-40c3-b658-064af0405b38 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029551 Jun 07 13:21:29.448356 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 473/951] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:30.351835 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ed9fc267-4693-4621-bf5a-81191a775eb7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:30.352538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ed9fc267-4693-4621-bf5a-81191a775eb7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:30.354423 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:30.355107 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:30.362595 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed9fc267-4693-4621-bf5a-81191a775eb7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:30.363047 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed9fc267-4693-4621-bf5a-81191a775eb7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:30.363812 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed9fc267-4693-4621-bf5a-81191a775eb7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:30.364251 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed9fc267-4693-4621-bf5a-81191a775eb7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:30.494281 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ed9fc267-4693-4621-bf5a-81191a775eb7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:30.501685 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ed9fc267-4693-4621-bf5a-81191a775eb7 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1363 microversion: 2.1 time: 0.153722 Jun 07 13:21:30.502258 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 479/952] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:30 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:31.515590 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=6 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:31.520484 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-44617263-1d23-4383-8f07-be21ec2624a1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:31.521186 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-44617263-1d23-4383-8f07-be21ec2624a1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:31.528008 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-44617263-1d23-4383-8f07-be21ec2624a1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:31.528461 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-44617263-1d23-4383-8f07-be21ec2624a1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:31.529257 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-44617263-1d23-4383-8f07-be21ec2624a1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:31.529698 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-44617263-1d23-4383-8f07-be21ec2624a1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:31.533712 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=83 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:31.655371 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-44617263-1d23-4383-8f07-be21ec2624a1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:31.663447 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-44617263-1d23-4383-8f07-be21ec2624a1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1549 microversion: 2.1 time: 0.148837 Jun 07 13:21:31.664026 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 474/953] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:31 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:31.680635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-069a8173-1b2c-44f7-9916-2a1b2ecc34dc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:31.681166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-069a8173-1b2c-44f7-9916-2a1b2ecc34dc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:31.683425 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:31.689393 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-069a8173-1b2c-44f7-9916-2a1b2ecc34dc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:31.689851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-069a8173-1b2c-44f7-9916-2a1b2ecc34dc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:31.690656 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-069a8173-1b2c-44f7-9916-2a1b2ecc34dc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:31.691097 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-069a8173-1b2c-44f7-9916-2a1b2ecc34dc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:31.767184 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-069a8173-1b2c-44f7-9916-2a1b2ecc34dc tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090294 Jun 07 13:21:31.767814 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 480/954] 10.222.0.58 () {58 vars in 1274 bytes} [Tue Jun 7 13:21:31 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:32.685765 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-bd162a00-a49d-4102-afb6-38413456b55d req-f2c8eacd-d00a-4c56-8778-31e2af8a0adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e529399b-e8ad-4d23-8b5d-6d6633ebf04c", "tag": "ad86f27e-afe4-4ff9-854c-46f40fe5246c"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:32.694482 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-bd162a00-a49d-4102-afb6-38413456b55d req-f2c8eacd-d00a-4c56-8778-31e2af8a0adb service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:32.694932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-bd162a00-a49d-4102-afb6-38413456b55d req-f2c8eacd-d00a-4c56-8778-31e2af8a0adb service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:32.705473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-bd162a00-a49d-4102-afb6-38413456b55d req-f2c8eacd-d00a-4c56-8778-31e2af8a0adb service nova] Creating event network-changed:ad86f27e-afe4-4ff9-854c-46f40fe5246c for instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c on hv-cinder-84496 Jun 07 13:21:32.710276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-bd162a00-a49d-4102-afb6-38413456b55d req-f2c8eacd-d00a-4c56-8778-31e2af8a0adb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028267 Jun 07 13:21:32.711071 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 475/955] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:40.303655 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cfa2229f-27fc-42d9-9157-5f1cb892088a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1163704819"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:40.304233 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cfa2229f-27fc-42d9-9157-5f1cb892088a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:40.311084 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cfa2229f-27fc-42d9-9157-5f1cb892088a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:40.311539 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cfa2229f-27fc-42d9-9157-5f1cb892088a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:40.312324 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cfa2229f-27fc-42d9-9157-5f1cb892088a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:40.312766 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cfa2229f-27fc-42d9-9157-5f1cb892088a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:40.463503 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.network.security_group_api [None req-cfa2229f-27fc-42d9-9157-5f1cb892088a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Removing security group 17c14561-ba24-4cfc-87cf-f381f8bb93bc from port 861926a2-c35d-4ff9-9ccf-2e5db51c909d Jun 07 13:21:40.947268 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cfa2229f-27fc-42d9-9157-5f1cb892088a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "POST /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/action" status: 202 len: 0 microversion: 2.1 time: 0.649527 Jun 07 13:21:40.952036 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 481/956] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jun 7 13:21:40 2022] POST /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:21:40.961247 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-4688f881-4bf1-4ce9-8785-dbbebe79853d req-0306fc70-541f-4eca-908b-8c66483bfcd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1300519b-aeac-4d90-a5ae-c2cf6ee62554", "tag": "861926a2-c35d-4ff9-9ccf-2e5db51c909d"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:40.971853 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-4688f881-4bf1-4ce9-8785-dbbebe79853d req-0306fc70-541f-4eca-908b-8c66483bfcd1 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:40.974338 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-4688f881-4bf1-4ce9-8785-dbbebe79853d req-0306fc70-541f-4eca-908b-8c66483bfcd1 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:40.981630 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8e13a4d2-e0e6-4378-9ac2-c47efbff2f58 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:40.982619 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8e13a4d2-e0e6-4378-9ac2-c47efbff2f58 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:40.993816 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8e13a4d2-e0e6-4378-9ac2-c47efbff2f58 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:40.995924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8e13a4d2-e0e6-4378-9ac2-c47efbff2f58 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:40.999248 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8e13a4d2-e0e6-4378-9ac2-c47efbff2f58 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:41.000900 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8e13a4d2-e0e6-4378-9ac2-c47efbff2f58 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:41.014629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-4688f881-4bf1-4ce9-8785-dbbebe79853d req-0306fc70-541f-4eca-908b-8c66483bfcd1 service nova] Creating event network-changed:861926a2-c35d-4ff9-9ccf-2e5db51c909d for instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 on hv-cinder-84496 Jun 07 13:21:41.030058 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-4688f881-4bf1-4ce9-8785-dbbebe79853d req-0306fc70-541f-4eca-908b-8c66483bfcd1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073904 Jun 07 13:21:41.033183 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 476/957] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:41.053677 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8e13a4d2-e0e6-4378-9ac2-c47efbff2f58 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/ips" status: 200 len: 149 microversion: 2.1 time: 0.076554 Jun 07 13:21:41.056946 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 482/958] 10.222.0.58 () {58 vars in 1247 bytes} [Tue Jun 7 13:21:40 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/ips => generated 149 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:21:42.389954 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-d8456f76-5ac4-43de-ab19-b302910503d2 req-e775a2b6-0456-4a79-8a8a-467385b7b137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1300519b-aeac-4d90-a5ae-c2cf6ee62554", "tag": "861926a2-c35d-4ff9-9ccf-2e5db51c909d"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:42.392247 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-efef3816-4b09-4ca7-a2e6-0983bf37218a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:42.394184 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-efef3816-4b09-4ca7-a2e6-0983bf37218a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:42.400015 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d8456f76-5ac4-43de-ab19-b302910503d2 req-e775a2b6-0456-4a79-8a8a-467385b7b137 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:42.400911 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d8456f76-5ac4-43de-ab19-b302910503d2 req-e775a2b6-0456-4a79-8a8a-467385b7b137 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:42.404688 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:42.407892 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-efef3816-4b09-4ca7-a2e6-0983bf37218a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:42.408411 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-efef3816-4b09-4ca7-a2e6-0983bf37218a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:42.409181 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-efef3816-4b09-4ca7-a2e6-0983bf37218a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:42.409646 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-efef3816-4b09-4ca7-a2e6-0983bf37218a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:42.419457 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-d8456f76-5ac4-43de-ab19-b302910503d2 req-e775a2b6-0456-4a79-8a8a-467385b7b137 service nova] Creating event network-changed:861926a2-c35d-4ff9-9ccf-2e5db51c909d for instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 on hv-cinder-84496 Jun 07 13:21:42.425090 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-d8456f76-5ac4-43de-ab19-b302910503d2 req-e775a2b6-0456-4a79-8a8a-467385b7b137 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038992 Jun 07 13:21:42.425971 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 483/959] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:21:42.529895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-efef3816-4b09-4ca7-a2e6-0983bf37218a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lazy-loading 'services' on Instance uuid 1300519b-aeac-4d90-a5ae-c2cf6ee62554 {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:21:42.655580 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-efef3816-4b09-4ca7-a2e6-0983bf37218a tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/os-volume_attachments/c39831d5-c4ed-4015-bfc8-a805ee8d0d54" status: 202 len: 0 microversion: 2.1 time: 0.270630 Jun 07 13:21:42.666104 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b1ef420a-32d5-4262-8974-259aa33f742d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:42.667335 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b1ef420a-32d5-4262-8974-259aa33f742d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:42.675084 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b1ef420a-32d5-4262-8974-259aa33f742d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:42.676399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b1ef420a-32d5-4262-8974-259aa33f742d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:42.677940 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b1ef420a-32d5-4262-8974-259aa33f742d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:42.678633 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b1ef420a-32d5-4262-8974-259aa33f742d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:42.680142 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 477/960] 10.222.0.58 () {58 vars in 1415 bytes} [Tue Jun 7 13:21:42 2022] DELETE /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/os-volume_attachments/c39831d5-c4ed-4015-bfc8-a805ee8d0d54 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:21:42.729651 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b1ef420a-32d5-4262-8974-259aa33f742d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067854 Jun 07 13:21:42.730753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 484/961] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:21:42 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:42.746134 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-872ff04b-de83-41db-ba8e-c26ec4fd504b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4ec8793-8bc6-4c1d-8f6c-13a5f03c1365"}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:42.747381 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-872ff04b-de83-41db-ba8e-c26ec4fd504b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:42.756140 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-872ff04b-de83-41db-ba8e-c26ec4fd504b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:42.756836 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-872ff04b-de83-41db-ba8e-c26ec4fd504b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:42.757788 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-872ff04b-de83-41db-ba8e-c26ec4fd504b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:42.758390 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-872ff04b-de83-41db-ba8e-c26ec4fd504b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:43.492676 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-872ff04b-de83-41db-ba8e-c26ec4fd504b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "POST /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.750762 Jun 07 13:21:43.500100 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 478/962] 10.222.0.58 () {60 vars in 1322 bytes} [Tue Jun 7 13:21:42 2022] POST /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments => generated 194 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:43.745898 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b037695c-603f-47d3-a7d6-bdb30288554c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:43.747033 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b037695c-603f-47d3-a7d6-bdb30288554c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:43.756441 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b037695c-603f-47d3-a7d6-bdb30288554c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:43.757735 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b037695c-603f-47d3-a7d6-bdb30288554c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:43.758543 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b037695c-603f-47d3-a7d6-bdb30288554c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:43.759475 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b037695c-603f-47d3-a7d6-bdb30288554c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:43.797893 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b037695c-603f-47d3-a7d6-bdb30288554c tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057649 Jun 07 13:21:43.798596 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 485/963] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:21:43 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:44.815311 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c86a7210-fa0d-40ac-bc30-5f4fe04ebf3e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:44.817653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c86a7210-fa0d-40ac-bc30-5f4fe04ebf3e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:44.824140 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c86a7210-fa0d-40ac-bc30-5f4fe04ebf3e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:44.824603 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c86a7210-fa0d-40ac-bc30-5f4fe04ebf3e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:44.825381 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c86a7210-fa0d-40ac-bc30-5f4fe04ebf3e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:44.825823 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c86a7210-fa0d-40ac-bc30-5f4fe04ebf3e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:44.866356 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c86a7210-fa0d-40ac-bc30-5f4fe04ebf3e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059066 Jun 07 13:21:44.867034 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 479/964] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:21:44 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:21:44.878388 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7baccb79-a5d1-47a7-82a7-2a1493cf1a5e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:44.879588 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7baccb79-a5d1-47a7-82a7-2a1493cf1a5e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:44.887411 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7baccb79-a5d1-47a7-82a7-2a1493cf1a5e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:44.887977 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7baccb79-a5d1-47a7-82a7-2a1493cf1a5e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:44.888936 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7baccb79-a5d1-47a7-82a7-2a1493cf1a5e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:44.889518 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7baccb79-a5d1-47a7-82a7-2a1493cf1a5e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:44.970746 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-7baccb79-a5d1-47a7-82a7-2a1493cf1a5e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] HTTP exception thrown: Instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 is not attached to volume c39831d5-c4ed-4015-bfc8-a805ee8d0d54 Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7baccb79-a5d1-47a7-82a7-2a1493cf1a5e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Request method failure captured: Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: DELETE /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/os-volume_attachments/c39831d5-c4ed-4015-bfc8-a805ee8d0d54 HTTP/1.1 Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin0_2ECa1kp7y6mpFPDLDSN41IU2B7NPTblB1JUzSwo9dg-Utn93-rZNwddFWkm_gokvsA_GpzYg8BocbAfp5Z6htU_l4sQf41grpBIR4Aa6ZQLX4lW4KubXOyA73PbntJtp8GvFz9vH7HlQlS1-JGrOjPge7CBqhIvLAeem39DaBQEI Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: fd9536c09221459485abe72ab8e43d99 Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-TestMinimumBasicScenario-547761998 Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:21:44.980219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:21:44.981874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd9536c09221459485abe72ab8e43d99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd9536c09221459485abe72ab8e43d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd9536c09221459485abe72ab8e43d99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd9536c09221459485abe72ab8e43d99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:21:44.981874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-TestMinimumBasicScenario-547761998 Jun 07 13:21:44.981874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: fd9536c09221459485abe72ab8e43d99 Jun 07 13:21:44.981874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-TestMinimumBasicScenario-547761998 Jun 07 13:21:44.981874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-TestMinimumBasicScenario-547761998-project Jun 07 13:21:44.981874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:21:44.981874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:21:44.981874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: f5c41cd95f8d4809803a6ab52ca9f714 Jun 07 13:21:44.981874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-TestMinimumBasicScenario-547761998-project Jun 07 13:21:44.981874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:21:44.981874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 is not attached to volume c39831d5-c4ed-4015-bfc8-a805ee8d0d54 Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'server_id': '1300519b-aeac-4d90-a5ae-c2cf6ee62554', 'id': 'c39831d5-c4ed-4015-bfc8-a805ee8d0d54'} Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c39831d5-c4ed-4015-bfc8-a805ee8d0d54. Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:21:44.982684 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:21:44.983930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:21:44.983930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 07 13:21:44.983930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 07 13:21:44.983930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 is not attached to volume c39831d5-c4ed-4015-bfc8-a805ee8d0d54 Jun 07 13:21:44.983930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:44.983930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:44.983930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:44.983930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:44.983930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:44.983930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:44.983930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:21:44.983930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:21:44.983930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 is not attached to volume c39831d5-c4ed-4015-bfc8-a805ee8d0d54 Jun 07 13:21:44.983930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:44.983930 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7baccb79-a5d1-47a7-82a7-2a1493cf1a5e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Returning 404 to user: Instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 is not attached to volume c39831d5-c4ed-4015-bfc8-a805ee8d0d54 {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:21:44.984871 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7baccb79-a5d1-47a7-82a7-2a1493cf1a5e tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/os-volume_attachments/c39831d5-c4ed-4015-bfc8-a805ee8d0d54" status: 404 len: 154 microversion: 2.1 time: 0.107988 Jun 07 13:21:44.984871 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 486/965] 10.222.0.58 () {58 vars in 1415 bytes} [Tue Jun 7 13:21:44 2022] DELETE /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554/os-volume_attachments/c39831d5-c4ed-4015-bfc8-a805ee8d0d54 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:21:46.118829 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1477e1eb-8523-4dbb-ba11-512589c21a9b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:46.119412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1477e1eb-8523-4dbb-ba11-512589c21a9b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:46.125970 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1477e1eb-8523-4dbb-ba11-512589c21a9b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:46.126416 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1477e1eb-8523-4dbb-ba11-512589c21a9b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:46.127209 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1477e1eb-8523-4dbb-ba11-512589c21a9b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:46.127645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1477e1eb-8523-4dbb-ba11-512589c21a9b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:46.160786 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1477e1eb-8523-4dbb-ba11-512589c21a9b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Going to try to terminate instance {{(pid=117797) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:21:46.260088 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1477e1eb-8523-4dbb-ba11-512589c21a9b tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 204 len: 0 microversion: 2.1 time: 0.146443 Jun 07 13:21:46.261006 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 480/966] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:21:46 2022] DELETE /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:21:46.269752 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-520ab0c3-bc86-4992-9f75-5f1024adc2f5 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:46.270573 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-520ab0c3-bc86-4992-9f75-5f1024adc2f5 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:46.278660 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-520ab0c3-bc86-4992-9f75-5f1024adc2f5 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:46.279337 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-520ab0c3-bc86-4992-9f75-5f1024adc2f5 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:46.280511 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-520ab0c3-bc86-4992-9f75-5f1024adc2f5 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:46.281177 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-520ab0c3-bc86-4992-9f75-5f1024adc2f5 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:46.426198 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-520ab0c3-bc86-4992-9f75-5f1024adc2f5 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:46.440914 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-520ab0c3-bc86-4992-9f75-5f1024adc2f5 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1554 microversion: 2.1 time: 0.175937 Jun 07 13:21:46.442057 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 487/967] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:46 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:47.462996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1c6cd492-d130-4ab3-bb6d-f00d328c16bf tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:47.463686 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1c6cd492-d130-4ab3-bb6d-f00d328c16bf tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:47.470056 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1c6cd492-d130-4ab3-bb6d-f00d328c16bf tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:47.470532 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1c6cd492-d130-4ab3-bb6d-f00d328c16bf tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:47.471283 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1c6cd492-d130-4ab3-bb6d-f00d328c16bf tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:47.471710 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1c6cd492-d130-4ab3-bb6d-f00d328c16bf tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:47.620125 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1c6cd492-d130-4ab3-bb6d-f00d328c16bf tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:47.627879 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1c6cd492-d130-4ab3-bb6d-f00d328c16bf tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1554 microversion: 2.1 time: 0.169099 Jun 07 13:21:47.628440 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 481/968] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:47 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:21:48.646016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3344920e-8c1a-463f-81b6-eb3c5551127d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:48.646849 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3344920e-8c1a-463f-81b6-eb3c5551127d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:48.653998 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3344920e-8c1a-463f-81b6-eb3c5551127d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:48.654589 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3344920e-8c1a-463f-81b6-eb3c5551127d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:48.655593 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3344920e-8c1a-463f-81b6-eb3c5551127d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:48.656196 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3344920e-8c1a-463f-81b6-eb3c5551127d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:48.901819 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3344920e-8c1a-463f-81b6-eb3c5551127d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:48.909809 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3344920e-8c1a-463f-81b6-eb3c5551127d tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1554 microversion: 2.1 time: 0.268348 Jun 07 13:21:48.910496 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 488/969] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:48 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1554 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:49.160489 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-c74c3c61-21e6-4620-931d-e9d9430cb6c4 req-6d0980c5-44e0-4215-9b8d-d070449a8c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1300519b-aeac-4d90-a5ae-c2cf6ee62554", "name": "network-vif-deleted", "tag": "861926a2-c35d-4ff9-9ccf-2e5db51c909d"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:49.173329 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-c74c3c61-21e6-4620-931d-e9d9430cb6c4 req-6d0980c5-44e0-4215-9b8d-d070449a8c5a service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:49.173770 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-c74c3c61-21e6-4620-931d-e9d9430cb6c4 req-6d0980c5-44e0-4215-9b8d-d070449a8c5a service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:49.185985 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-c74c3c61-21e6-4620-931d-e9d9430cb6c4 req-6d0980c5-44e0-4215-9b8d-d070449a8c5a service nova] Creating event network-vif-deleted:861926a2-c35d-4ff9-9ccf-2e5db51c909d for instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 on hv-cinder-84496 Jun 07 13:21:49.192313 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-c74c3c61-21e6-4620-931d-e9d9430cb6c4 req-6d0980c5-44e0-4215-9b8d-d070449a8c5a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034254 Jun 07 13:21:49.193340 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 482/970] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:49.929715 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-96414238-55b6-4c05-b6ea-029aa44b4782 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:49.930770 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-96414238-55b6-4c05-b6ea-029aa44b4782 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:49.940253 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-96414238-55b6-4c05-b6ea-029aa44b4782 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:49.940707 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-96414238-55b6-4c05-b6ea-029aa44b4782 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:49.941478 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-96414238-55b6-4c05-b6ea-029aa44b4782 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:49.941998 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-96414238-55b6-4c05-b6ea-029aa44b4782 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:49.972867 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-96414238-55b6-4c05-b6ea-029aa44b4782 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:49.973317 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-96414238-55b6-4c05-b6ea-029aa44b4782 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:49.973762 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-96414238-55b6-4c05-b6ea-029aa44b4782 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lazy-loading 'fault' on Instance uuid 1300519b-aeac-4d90-a5ae-c2cf6ee62554 {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:21:50.021021 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-96414238-55b6-4c05-b6ea-029aa44b4782 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c41cd95f8d4809803a6ab52ca9f714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9536c09221459485abe72ab8e43d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:50.028801 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-96414238-55b6-4c05-b6ea-029aa44b4782 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 200 len: 1348 microversion: 2.1 time: 0.105604 Jun 07 13:21:50.029367 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 489/971] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:49 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:51.047085 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1612160d-37ca-49de-bd67-0c47e224e2b0 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:51.047724 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1612160d-37ca-49de-bd67-0c47e224e2b0 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] [instance: 1300519b-aeac-4d90-a5ae-c2cf6ee62554] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:51.055329 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1612160d-37ca-49de-bd67-0c47e224e2b0 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:51.055784 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1612160d-37ca-49de-bd67-0c47e224e2b0 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:51.056564 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1612160d-37ca-49de-bd67-0c47e224e2b0 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:51.057061 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1612160d-37ca-49de-bd67-0c47e224e2b0 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:51.071427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-1612160d-37ca-49de-bd67-0c47e224e2b0 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] HTTP exception thrown: Instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 could not be found. Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1612160d-37ca-49de-bd67-0c47e224e2b0 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Request method failure captured: Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 HTTP/1.1 Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin0_2ECa1kp7y6mpFPDLDSN41IU2B7NPTblB1JUzSwo9dg-Utn93-rZNwddFWkm_gokvsA_GpzYg8BocbAfp5Z6htU_l4sQf41grpBIR4Aa6ZQLX4lW4KubXOyA73PbntJtp8GvFz9vH7HlQlS1-JGrOjPge7CBqhIvLAeem39DaBQEI Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: fd9536c09221459485abe72ab8e43d99 Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-TestMinimumBasicScenario-547761998 Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:21:51.073258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:21:51.075105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd9536c09221459485abe72ab8e43d99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd9536c09221459485abe72ab8e43d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd9536c09221459485abe72ab8e43d99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd9536c09221459485abe72ab8e43d99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:21:51.075105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-TestMinimumBasicScenario-547761998 Jun 07 13:21:51.075105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: fd9536c09221459485abe72ab8e43d99 Jun 07 13:21:51.075105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-TestMinimumBasicScenario-547761998 Jun 07 13:21:51.075105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-TestMinimumBasicScenario-547761998-project Jun 07 13:21:51.075105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:21:51.075105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:21:51.075105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: f5c41cd95f8d4809803a6ab52ca9f714 Jun 07 13:21:51.075105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-TestMinimumBasicScenario-547761998-project Jun 07 13:21:51.075105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:21:51.075105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 could not be found. Jun 07 13:21:51.075105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': '1300519b-aeac-4d90-a5ae-c2cf6ee62554'} Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 could not be found. Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:21:51.076067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 could not be found. Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 could not be found. Jun 07 13:21:51.077662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:21:51.079045 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1612160d-37ca-49de-bd67-0c47e224e2b0 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Returning 404 to user: Instance 1300519b-aeac-4d90-a5ae-c2cf6ee62554 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:21:51.079045 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1612160d-37ca-49de-bd67-0c47e224e2b0 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554" status: 404 len: 111 microversion: 2.1 time: 0.032541 Jun 07 13:21:51.079045 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 483/972] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:51 2022] GET /compute/v2.1/servers/1300519b-aeac-4d90-a5ae-c2cf6ee62554 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:21:51.080357 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-436402a1-16df-4224-8e1e-475b6880db44 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4ec8793-8bc6-4c1d-8f6c-13a5f03c1365"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:51.081534 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-436402a1-16df-4224-8e1e-475b6880db44 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:51.083914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-75c17cd0-6445-4bbe-a44d-6221ced750a4 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] Calling method '.version_select at 0x7fb8f8f63d30>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:51.088121 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-436402a1-16df-4224-8e1e-475b6880db44 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:51.088562 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-436402a1-16df-4224-8e1e-475b6880db44 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:51.089336 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-436402a1-16df-4224-8e1e-475b6880db44 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:51.089846 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-436402a1-16df-4224-8e1e-475b6880db44 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:51.101696 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-75c17cd0-6445-4bbe-a44d-6221ced750a4 tempest-TestMinimumBasicScenario-547761998 tempest-TestMinimumBasicScenario-547761998-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-656246516" status: 202 len: 0 microversion: 2.1 time: 0.021935 Jun 07 13:21:51.102508 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 484/973] 10.222.0.58 () {58 vars in 1268 bytes} [Tue Jun 7 13:21:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-656246516 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:21:51.180723 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-436402a1-16df-4224-8e1e-475b6880db44 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] HTTP exception thrown: Invalid volume: volume f4ec8793-8bc6-4c1d-8f6c-13a5f03c1365 is already attached to instances: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-436402a1-16df-4224-8e1e-475b6880db44 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Request method failure captured: Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: POST /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments HTTP/1.1 Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 74 Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08U-o1RXkpPvRpL7xDzNFmHnSj255NFDhEpduNc0925DPg27io8CB6KRvQZuxcGtY7Iz0iEoMVidEoHUACL1lIGmUyRUR_8aMLzRLJXAMtSSy6JOQkiG83CLgwqXPfpWRfIbnqNAok3xO_9QFcJIn-p7dfSyPkb5TLmEFYuzTkAq94 Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:21:51.182795 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:21:51.184404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd6f908209c418490bccdbdef7691a5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:21:51.184404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:21:51.184404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:21:51.184404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:21:51.184404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:21:51.184404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:21:51.184404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:21:51.184404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 3f1a9bfb57f64b85b635c29090aa498c Jun 07 13:21:51.184404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:21:51.184404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Jun 07 13:21:51.184404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {"volumeAttachment": {"volumeId": "f4ec8793-8bc6-4c1d-8f6c-13a5f03c1365"}} Jun 07 13:21:51.184404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Invalid volume: volume f4ec8793-8bc6-4c1d-8f6c-13a5f03c1365 is already attached to instances: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'server_id': '771de6d7-c5ac-4fe8-9706-dee8ef1564bc', 'body': {'volumeAttachment': {'volumeId': 'f4ec8793-8bc6-4c1d-8f6c-13a5f03c1365'}}} Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f4ec8793-8bc6-4c1d-8f6c-13a5f03c1365 is already attached to instances: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:51.185348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f4ec8793-8bc6-4c1d-8f6c-13a5f03c1365 is already attached to instances: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:51.186845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:51.188335 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:51.188335 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:21:51.188335 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:21:51.188335 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f4ec8793-8bc6-4c1d-8f6c-13a5f03c1365 is already attached to instances: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc Jun 07 13:21:51.188335 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:21:51.188335 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-436402a1-16df-4224-8e1e-475b6880db44 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Returning 400 to user: Invalid volume: volume f4ec8793-8bc6-4c1d-8f6c-13a5f03c1365 is already attached to instances: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:21:51.188335 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-436402a1-16df-4224-8e1e-475b6880db44 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "POST /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110739 Jun 07 13:21:51.188335 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 490/974] 10.222.0.58 () {60 vars in 1322 bytes} [Tue Jun 7 13:21:51 2022] POST /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 07 13:21:51.249049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-4951c39b-0194-41e1-82b3-25341471cf83 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:51.249583 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-4951c39b-0194-41e1-82b3-25341471cf83 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:51.258366 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4951c39b-0194-41e1-82b3-25341471cf83 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:51.259468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4951c39b-0194-41e1-82b3-25341471cf83 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:51.260237 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4951c39b-0194-41e1-82b3-25341471cf83 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:51.260671 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4951c39b-0194-41e1-82b3-25341471cf83 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:51.344376 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-4951c39b-0194-41e1-82b3-25341471cf83 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lazy-loading 'services' on Instance uuid 771de6d7-c5ac-4fe8-9706-dee8ef1564bc {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:21:51.420663 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-4951c39b-0194-41e1-82b3-25341471cf83 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "DELETE /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments/f4ec8793-8bc6-4c1d-8f6c-13a5f03c1365" status: 202 len: 0 microversion: 2.1 time: 0.175297 Jun 07 13:21:51.421258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 485/975] 10.222.0.58 () {58 vars in 1415 bytes} [Tue Jun 7 13:21:51 2022] DELETE /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments/f4ec8793-8bc6-4c1d-8f6c-13a5f03c1365 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:21:51.430608 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9da80a8e-0628-4ad9-98dc-feb780b16e60 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:51.431613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9da80a8e-0628-4ad9-98dc-feb780b16e60 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:51.444480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9da80a8e-0628-4ad9-98dc-feb780b16e60 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:51.445172 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9da80a8e-0628-4ad9-98dc-feb780b16e60 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:51.446064 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9da80a8e-0628-4ad9-98dc-feb780b16e60 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:51.446381 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9da80a8e-0628-4ad9-98dc-feb780b16e60 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:51.478293 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9da80a8e-0628-4ad9-98dc-feb780b16e60 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052471 Jun 07 13:21:51.482136 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 491/976] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:21:51 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:52.491702 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-95849901-4c18-44ef-9524-33d8b2df515c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:52.492729 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-95849901-4c18-44ef-9524-33d8b2df515c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:52.498939 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-95849901-4c18-44ef-9524-33d8b2df515c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:52.499393 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-95849901-4c18-44ef-9524-33d8b2df515c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:52.500160 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-95849901-4c18-44ef-9524-33d8b2df515c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:52.500595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-95849901-4c18-44ef-9524-33d8b2df515c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:52.531015 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-95849901-4c18-44ef-9524-33d8b2df515c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044824 Jun 07 13:21:52.531601 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 486/977] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:21:52 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:53.546830 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bf2b7fe9-e6fe-4688-8ed2-ce70614950ad tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:53.548947 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bf2b7fe9-e6fe-4688-8ed2-ce70614950ad tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:53.561868 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf2b7fe9-e6fe-4688-8ed2-ce70614950ad tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:53.562776 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf2b7fe9-e6fe-4688-8ed2-ce70614950ad tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:53.564099 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf2b7fe9-e6fe-4688-8ed2-ce70614950ad tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:53.564580 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf2b7fe9-e6fe-4688-8ed2-ce70614950ad tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:53.603256 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bf2b7fe9-e6fe-4688-8ed2-ce70614950ad tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062892 Jun 07 13:21:53.603256 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 492/978] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:21:53 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:54.616389 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-286d15db-910f-4fb5-9b20-cb40d3dc88e9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:54.618576 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-286d15db-910f-4fb5-9b20-cb40d3dc88e9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:54.630820 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-286d15db-910f-4fb5-9b20-cb40d3dc88e9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:54.631428 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-286d15db-910f-4fb5-9b20-cb40d3dc88e9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:54.632581 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-286d15db-910f-4fb5-9b20-cb40d3dc88e9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:54.633172 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-286d15db-910f-4fb5-9b20-cb40d3dc88e9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:54.685841 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-286d15db-910f-4fb5-9b20-cb40d3dc88e9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075256 Jun 07 13:21:54.686634 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 487/979] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:21:54 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:21:55.697991 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b05e2258-940d-45f8-ba5c-2f4fc6e7ced2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:55.703288 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b05e2258-940d-45f8-ba5c-2f4fc6e7ced2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:55.709847 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b05e2258-940d-45f8-ba5c-2f4fc6e7ced2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:55.710304 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b05e2258-940d-45f8-ba5c-2f4fc6e7ced2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:55.711124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b05e2258-940d-45f8-ba5c-2f4fc6e7ced2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:55.711568 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b05e2258-940d-45f8-ba5c-2f4fc6e7ced2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:55.742735 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b05e2258-940d-45f8-ba5c-2f4fc6e7ced2 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048702 Jun 07 13:21:55.743706 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 493/980] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:21:55 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:56.755543 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-82223b4c-51ea-43cf-8106-67f0369e9b09 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:56.756465 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-82223b4c-51ea-43cf-8106-67f0369e9b09 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:56.762903 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-82223b4c-51ea-43cf-8106-67f0369e9b09 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:56.763276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-82223b4c-51ea-43cf-8106-67f0369e9b09 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:56.764226 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-82223b4c-51ea-43cf-8106-67f0369e9b09 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:56.764869 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-82223b4c-51ea-43cf-8106-67f0369e9b09 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:56.796085 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-82223b4c-51ea-43cf-8106-67f0369e9b09 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044872 Jun 07 13:21:56.797019 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 488/981] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:21:56 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:21:56.867139 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-21841ab8-15fc-4648-a2e7-315de625052a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:56.868367 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-21841ab8-15fc-4648-a2e7-315de625052a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:56.883599 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21841ab8-15fc-4648-a2e7-315de625052a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:56.884373 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21841ab8-15fc-4648-a2e7-315de625052a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:56.885525 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21841ab8-15fc-4648-a2e7-315de625052a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:56.886163 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21841ab8-15fc-4648-a2e7-315de625052a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:56.923246 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-21841ab8-15fc-4648-a2e7-315de625052a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:21:56.987699 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:57.047323 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-21841ab8-15fc-4648-a2e7-315de625052a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "DELETE /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 204 len: 0 microversion: 2.1 time: 0.185199 Jun 07 13:21:57.048610 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 494/982] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:21:56 2022] DELETE /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:21:57.062271 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-23bf649a-c7a2-4009-86eb-ce439631149f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:57.063502 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-23bf649a-c7a2-4009-86eb-ce439631149f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:57.070194 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-23bf649a-c7a2-4009-86eb-ce439631149f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:57.071128 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-23bf649a-c7a2-4009-86eb-ce439631149f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:57.072344 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-23bf649a-c7a2-4009-86eb-ce439631149f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:57.072891 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-23bf649a-c7a2-4009-86eb-ce439631149f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:57.485533 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-23bf649a-c7a2-4009-86eb-ce439631149f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:57.508330 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-23bf649a-c7a2-4009-86eb-ce439631149f tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1681 microversion: 2.1 time: 0.448380 Jun 07 13:21:57.509186 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 489/983] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:57 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1681 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:58.528720 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e63aae14-38ed-4cae-a1eb-0d28bc4d6dcc tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:58.530237 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e63aae14-38ed-4cae-a1eb-0d28bc4d6dcc tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:58.540807 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e63aae14-38ed-4cae-a1eb-0d28bc4d6dcc tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:58.541367 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e63aae14-38ed-4cae-a1eb-0d28bc4d6dcc tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:58.542296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e63aae14-38ed-4cae-a1eb-0d28bc4d6dcc tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:58.543244 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e63aae14-38ed-4cae-a1eb-0d28bc4d6dcc tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:58.705207 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e63aae14-38ed-4cae-a1eb-0d28bc4d6dcc tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:58.720029 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e63aae14-38ed-4cae-a1eb-0d28bc4d6dcc tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1681 microversion: 2.1 time: 0.197450 Jun 07 13:21:58.730810 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 495/984] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:58 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1681 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:59.741156 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-dec3f6c2-4f1b-4b74-9cab-941eb1452d24 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:59.741943 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-dec3f6c2-4f1b-4b74-9cab-941eb1452d24 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:59.749581 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dec3f6c2-4f1b-4b74-9cab-941eb1452d24 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:59.750161 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dec3f6c2-4f1b-4b74-9cab-941eb1452d24 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:59.751011 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dec3f6c2-4f1b-4b74-9cab-941eb1452d24 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:59.751459 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dec3f6c2-4f1b-4b74-9cab-941eb1452d24 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:59.756442 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:59.821884 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-dec3f6c2-4f1b-4b74-9cab-941eb1452d24 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:59.837609 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-dec3f6c2-4f1b-4b74-9cab-941eb1452d24 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 200 len: 1614 microversion: 2.1 time: 0.100143 Jun 07 13:21:59.838560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 490/985] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:59 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 1614 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:00.127609 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-801e77c6-1b47-4ed0-a941-c1c397346c72 req-1369364b-d817-413e-99d4-cd2eadfe607e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771de6d7-c5ac-4fe8-9706-dee8ef1564bc", "name": "network-vif-deleted", "tag": "a1d422ae-82e2-478f-8ea1-ce6ed50756ea"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:00.137480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-801e77c6-1b47-4ed0-a941-c1c397346c72 req-1369364b-d817-413e-99d4-cd2eadfe607e service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:00.138044 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-801e77c6-1b47-4ed0-a941-c1c397346c72 req-1369364b-d817-413e-99d4-cd2eadfe607e service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:00.157763 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-801e77c6-1b47-4ed0-a941-c1c397346c72 req-1369364b-d817-413e-99d4-cd2eadfe607e service nova] Creating event network-vif-deleted:a1d422ae-82e2-478f-8ea1-ce6ed50756ea for instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc on hv-cinder-84496 Jun 07 13:22:00.164427 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-801e77c6-1b47-4ed0-a941-c1c397346c72 req-1369364b-d817-413e-99d4-cd2eadfe607e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040347 Jun 07 13:22:00.165832 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 496/986] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:00.854479 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ffed0065-9f5a-40e6-9d31-bb85b8526258 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:00.855339 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ffed0065-9f5a-40e6-9d31-bb85b8526258 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:00.861678 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ffed0065-9f5a-40e6-9d31-bb85b8526258 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:00.862122 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ffed0065-9f5a-40e6-9d31-bb85b8526258 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:00.862911 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ffed0065-9f5a-40e6-9d31-bb85b8526258 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:00.864207 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ffed0065-9f5a-40e6-9d31-bb85b8526258 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:00.880283 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-ffed0065-9f5a-40e6-9d31-bb85b8526258 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] HTTP exception thrown: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ffed0065-9f5a-40e6-9d31-bb85b8526258 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Request method failure captured: Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc HTTP/1.1 Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08U-o1RXkpPvRpL7xDzNFmHnSj255NFDhEpduNc0925DPg27io8CB6KRvQZuxcGtY7Iz0iEoMVidEoHUACL1lIGmUyRUR_8aMLzRLJXAMtSSy6JOQkiG83CLgwqXPfpWRfIbnqNAok3xO_9QFcJIn-p7dfSyPkb5TLmEFYuzTkAq94 Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:22:00.882152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:22:00.883763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd6f908209c418490bccdbdef7691a5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:22:00.883763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:22:00.883763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:22:00.883763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:22:00.883763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:22:00.883763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:22:00.883763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:22:00.883763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 3f1a9bfb57f64b85b635c29090aa498c Jun 07 13:22:00.883763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:22:00.883763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:22:00.883763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. Jun 07 13:22:00.883763 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': '771de6d7-c5ac-4fe8-9706-dee8ef1564bc'} Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:00.884653 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. Jun 07 13:22:00.886154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:22:00.888616 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ffed0065-9f5a-40e6-9d31-bb85b8526258 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Returning 404 to user: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:00.888616 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ffed0065-9f5a-40e6-9d31-bb85b8526258 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 404 len: 111 microversion: 2.1 time: 0.032988 Jun 07 13:22:00.888616 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 491/987] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:00 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:22:00.896468 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3231e48a-f991-4fae-a9a6-6ee06ae99532 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '.version_select at 0x7fb8e77850d0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:00.920815 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3231e48a-f991-4fae-a9a6-6ee06ae99532 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143139216" status: 202 len: 0 microversion: 2.1 time: 0.029178 Jun 07 13:22:00.921354 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 497/988] 10.222.0.58 () {58 vars in 1220 bytes} [Tue Jun 7 13:22:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143139216 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 13:22:01.679820 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-412066db-ae79-4c5f-b6e5-b9bedcb9cf70 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Action: 'create', calling method: .version_select at 0x7fb8f4a8c430>, body: {"keypair": {"name": "tempest-keypair-1899470818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDku4DCFsFbkIdIW1Esg3tEur0Hn2wiAoK1djBWdiUh927YAhgbB/ju4rKRfZDPuHWvM17eYDiDfZO3E/bf8Xwezzz7ng59k57YfRLkFF627E9Cl2JyAsCNf4UCXTaFFpw=="}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:01.705603 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-412066db-ae79-4c5f-b6e5-b9bedcb9cf70 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Getting quotas for project 3fd6f908209c418490bccdbdef7691a5. Resources: {'key_pairs'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:22:01.710689 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-412066db-ae79-4c5f-b6e5-b9bedcb9cf70 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Getting quotas for user 3f1a9bfb57f64b85b635c29090aa498c and project 3fd6f908209c418490bccdbdef7691a5. Resources: {'key_pairs'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:22:01.746747 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-412066db-ae79-4c5f-b6e5-b9bedcb9cf70 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073448 Jun 07 13:22:01.746747 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 492/989] 10.222.0.58 () {60 vars in 1158 bytes} [Tue Jun 7 13:22:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:04.476076 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3141f6fd-b67f-40be-9f77-71b1660ed474 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-301419498", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a83b14f0-daca-457b-9e46-5ac0b9a7ecdf"}], "security_groups": [{"name": "tempest-securitygroup--2068671448"}], "key_name": "tempest-keypair-1899470818", "user_data": "}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:04.483062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:04.609570 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-3141f6fd-b67f-40be-9f77-71b1660ed474 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] validate_networks() for [('a83b14f0-daca-457b-9e46-5ac0b9a7ecdf', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:22:05.269372 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-3141f6fd-b67f-40be-9f77-71b1660ed474 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:22:05.270767 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-3141f6fd-b67f-40be-9f77-71b1660ed474 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:22:05.271353 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-3141f6fd-b67f-40be-9f77-71b1660ed474 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:22:05.272035 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-3141f6fd-b67f-40be-9f77-71b1660ed474 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:22:05.272789 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-3141f6fd-b67f-40be-9f77-71b1660ed474 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:22:05.283187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3141f6fd-b67f-40be-9f77-71b1660ed474 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:05.284037 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3141f6fd-b67f-40be-9f77-71b1660ed474 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:05.285132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3141f6fd-b67f-40be-9f77-71b1660ed474 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:05.286664 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3141f6fd-b67f-40be-9f77-71b1660ed474 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:05.313698 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-3141f6fd-b67f-40be-9f77-71b1660ed474 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Getting quotas for project 3fd6f908209c418490bccdbdef7691a5. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:22:05.323113 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-3141f6fd-b67f-40be-9f77-71b1660ed474 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Getting quotas for user 3f1a9bfb57f64b85b635c29090aa498c and project 3fd6f908209c418490bccdbdef7691a5. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:22:05.339614 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3141f6fd-b67f-40be-9f77-71b1660ed474 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:22:05.342691 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3141f6fd-b67f-40be-9f77-71b1660ed474 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:22:05.409376 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3141f6fd-b67f-40be-9f77-71b1660ed474 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.938799 Jun 07 13:22:05.416200 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 498/990] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:22:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:22:05.426037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c1faf532-2bfc-432f-b573-f8df10d219fd tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:05.432303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c1faf532-2bfc-432f-b573-f8df10d219fd tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:05.572102 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c1faf532-2bfc-432f-b573-f8df10d219fd tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:05.580882 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c1faf532-2bfc-432f-b573-f8df10d219fd tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1241 microversion: 2.1 time: 0.162911 Jun 07 13:22:05.582526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 493/991] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:05 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1241 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:06.600356 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2ac33a8f-c9d0-4901-aad8-a8e2e3c63586 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:06.601592 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2ac33a8f-c9d0-4901-aad8-a8e2e3c63586 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:06.613525 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ac33a8f-c9d0-4901-aad8-a8e2e3c63586 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:06.615481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ac33a8f-c9d0-4901-aad8-a8e2e3c63586 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:06.616491 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ac33a8f-c9d0-4901-aad8-a8e2e3c63586 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:06.616931 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ac33a8f-c9d0-4901-aad8-a8e2e3c63586 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:06.702294 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2ac33a8f-c9d0-4901-aad8-a8e2e3c63586 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:06.711752 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2ac33a8f-c9d0-4901-aad8-a8e2e3c63586 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1293 microversion: 2.1 time: 0.116428 Jun 07 13:22:06.712912 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 499/992] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:06 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1293 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:07.729779 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5dc29729-0e4a-4ba1-81ab-a64f5adbb9b5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:07.730683 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5dc29729-0e4a-4ba1-81ab-a64f5adbb9b5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:07.738765 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5dc29729-0e4a-4ba1-81ab-a64f5adbb9b5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:07.739485 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5dc29729-0e4a-4ba1-81ab-a64f5adbb9b5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:07.740640 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5dc29729-0e4a-4ba1-81ab-a64f5adbb9b5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:07.741271 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5dc29729-0e4a-4ba1-81ab-a64f5adbb9b5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:07.865883 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5dc29729-0e4a-4ba1-81ab-a64f5adbb9b5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:07.881929 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5dc29729-0e4a-4ba1-81ab-a64f5adbb9b5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1299 microversion: 2.1 time: 0.155971 Jun 07 13:22:07.882540 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 494/993] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:07 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1299 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:08.900651 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0faccc61-8a57-479f-955e-6c8693fd3312 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:08.905014 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0faccc61-8a57-479f-955e-6c8693fd3312 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:08.918920 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0faccc61-8a57-479f-955e-6c8693fd3312 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:08.920037 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0faccc61-8a57-479f-955e-6c8693fd3312 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:08.922680 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0faccc61-8a57-479f-955e-6c8693fd3312 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:08.923808 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0faccc61-8a57-479f-955e-6c8693fd3312 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:09.700368 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0faccc61-8a57-479f-955e-6c8693fd3312 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:09.709928 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0faccc61-8a57-479f-955e-6c8693fd3312 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1367 microversion: 2.1 time: 0.815069 Jun 07 13:22:09.711603 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 500/994] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:08 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1367 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:09.793904 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-6a815d3c-7fb8-4266-b62f-599fefb4defc req-bd9194b9-83a9-4b32-9453-62f887a5ec20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25e18880-cb5c-4346-9a43-a861b07f27a8", "tag": "d0c830a1-4526-4f25-a02e-0ee9838a85ba"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:09.799405 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ac3de27d-db9e-4140-af5e-b99719ab228d tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:09.799919 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ac3de27d-db9e-4140-af5e-b99719ab228d tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:09.812518 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ac3de27d-db9e-4140-af5e-b99719ab228d tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:09.814571 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-6a815d3c-7fb8-4266-b62f-599fefb4defc req-bd9194b9-83a9-4b32-9453-62f887a5ec20 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:09.815330 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ac3de27d-db9e-4140-af5e-b99719ab228d tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:09.816449 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-6a815d3c-7fb8-4266-b62f-599fefb4defc req-bd9194b9-83a9-4b32-9453-62f887a5ec20 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:09.817116 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ac3de27d-db9e-4140-af5e-b99719ab228d tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:09.821926 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ac3de27d-db9e-4140-af5e-b99719ab228d tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:09.865089 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-6a815d3c-7fb8-4266-b62f-599fefb4defc req-bd9194b9-83a9-4b32-9453-62f887a5ec20 service nova] Creating event network-changed:d0c830a1-4526-4f25-a02e-0ee9838a85ba for instance 25e18880-cb5c-4346-9a43-a861b07f27a8 on hv-cinder-84496 Jun 07 13:22:09.874752 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-6a815d3c-7fb8-4266-b62f-599fefb4defc req-bd9194b9-83a9-4b32-9453-62f887a5ec20 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084511 Jun 07 13:22:09.879024 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 501/995] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:09.902618 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ac3de27d-db9e-4140-af5e-b99719ab228d tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Going to try to terminate instance {{(pid=117797) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:22:10.068865 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ac3de27d-db9e-4140-af5e-b99719ab228d tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "DELETE /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 204 len: 0 microversion: 2.1 time: 0.281806 Jun 07 13:22:10.070513 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 495/996] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:22:09 2022] DELETE /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:22:10.088386 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e1baa0c3-a49c-4660-93bb-26bf17b8c2c9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:10.090862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e1baa0c3-a49c-4660-93bb-26bf17b8c2c9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:10.102689 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e1baa0c3-a49c-4660-93bb-26bf17b8c2c9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:10.104964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e1baa0c3-a49c-4660-93bb-26bf17b8c2c9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:10.106046 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e1baa0c3-a49c-4660-93bb-26bf17b8c2c9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:10.106832 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e1baa0c3-a49c-4660-93bb-26bf17b8c2c9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:10.504331 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e1baa0c3-a49c-4660-93bb-26bf17b8c2c9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:10.517155 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e1baa0c3-a49c-4660-93bb-26bf17b8c2c9 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.442017 Jun 07 13:22:10.528074 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 502/997] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:10 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:10.736834 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-acdaee32-0365-4ea4-81dc-cd1ce6e6259c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:10.738624 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-acdaee32-0365-4ea4-81dc-cd1ce6e6259c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:10.746834 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-acdaee32-0365-4ea4-81dc-cd1ce6e6259c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:10.747596 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-acdaee32-0365-4ea4-81dc-cd1ce6e6259c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:10.748546 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-acdaee32-0365-4ea4-81dc-cd1ce6e6259c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:10.749362 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-acdaee32-0365-4ea4-81dc-cd1ce6e6259c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:11.045953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-15f477a2-90ed-4c27-8a65-3a38bcf95252 req-039b443d-55b7-4dc0-8071-7aa51806586b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a922d01f-0f88-45e9-a764-84e36becc80b", "tag": "02ca69ec-a548-40b3-8958-bfe7e017d9c2"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:11.068499 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-acdaee32-0365-4ea4-81dc-cd1ce6e6259c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:11.075445 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-15f477a2-90ed-4c27-8a65-3a38bcf95252 req-039b443d-55b7-4dc0-8071-7aa51806586b service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:11.075897 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-15f477a2-90ed-4c27-8a65-3a38bcf95252 req-039b443d-55b7-4dc0-8071-7aa51806586b service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:11.085572 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-acdaee32-0365-4ea4-81dc-cd1ce6e6259c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1367 microversion: 2.1 time: 0.359506 Jun 07 13:22:11.090490 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 496/998] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:10 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:11.116228 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-15f477a2-90ed-4c27-8a65-3a38bcf95252 req-039b443d-55b7-4dc0-8071-7aa51806586b service nova] Creating event network-changed:02ca69ec-a548-40b3-8958-bfe7e017d9c2 for instance a922d01f-0f88-45e9-a764-84e36becc80b on hv-cinder-84496 Jun 07 13:22:11.130214 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-15f477a2-90ed-4c27-8a65-3a38bcf95252 req-039b443d-55b7-4dc0-8071-7aa51806586b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093846 Jun 07 13:22:11.132262 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 503/999] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:11.536960 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c3e73333-ddba-44e2-accd-7f665aadf3ca tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:11.537569 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c3e73333-ddba-44e2-accd-7f665aadf3ca tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:11.546429 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c3e73333-ddba-44e2-accd-7f665aadf3ca tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:11.547346 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c3e73333-ddba-44e2-accd-7f665aadf3ca tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:11.548348 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c3e73333-ddba-44e2-accd-7f665aadf3ca tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:11.549056 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c3e73333-ddba-44e2-accd-7f665aadf3ca tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:11.822589 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c3e73333-ddba-44e2-accd-7f665aadf3ca tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:11.842166 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c3e73333-ddba-44e2-accd-7f665aadf3ca tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.310100 Jun 07 13:22:11.843550 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 497/1000] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:11 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:12.102543 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-79987665-9653-45c5-a2fb-41c8445b610a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:12.103253 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-79987665-9653-45c5-a2fb-41c8445b610a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:12.112111 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-79987665-9653-45c5-a2fb-41c8445b610a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:12.112557 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-79987665-9653-45c5-a2fb-41c8445b610a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:12.113852 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-79987665-9653-45c5-a2fb-41c8445b610a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:12.129574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-79987665-9653-45c5-a2fb-41c8445b610a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:12.860228 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5a6376cb-840f-40eb-9445-331a9572f59c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:12.861495 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5a6376cb-840f-40eb-9445-331a9572f59c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:12.865738 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:12.872235 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5a6376cb-840f-40eb-9445-331a9572f59c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:12.872853 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5a6376cb-840f-40eb-9445-331a9572f59c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:12.874280 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5a6376cb-840f-40eb-9445-331a9572f59c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:12.874869 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5a6376cb-840f-40eb-9445-331a9572f59c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:13.112720 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5a6376cb-840f-40eb-9445-331a9572f59c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:13.126283 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5a6376cb-840f-40eb-9445-331a9572f59c tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1569 microversion: 2.1 time: 0.269947 Jun 07 13:22:13.127441 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 498/1001] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:12 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1569 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:13.289485 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-79987665-9653-45c5-a2fb-41c8445b610a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:13.297695 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-79987665-9653-45c5-a2fb-41c8445b610a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1367 microversion: 2.1 time: 1.199278 Jun 07 13:22:13.298351 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 504/1002] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:12 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1367 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:14.112814 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-025d6fcd-ebd2-4b09-91f2-26d05930c1f6 req-fdc0865b-bf88-4b6f-b129-1ed8f20f5e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e18880-cb5c-4346-9a43-a861b07f27a8", "name": "network-vif-deleted", "tag": "d0c830a1-4526-4f25-a02e-0ee9838a85ba"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:14.122452 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-025d6fcd-ebd2-4b09-91f2-26d05930c1f6 req-fdc0865b-bf88-4b6f-b129-1ed8f20f5e74 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:14.122921 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-025d6fcd-ebd2-4b09-91f2-26d05930c1f6 req-fdc0865b-bf88-4b6f-b129-1ed8f20f5e74 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:14.135018 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-025d6fcd-ebd2-4b09-91f2-26d05930c1f6 req-fdc0865b-bf88-4b6f-b129-1ed8f20f5e74 service nova] Creating event network-vif-deleted:d0c830a1-4526-4f25-a02e-0ee9838a85ba for instance 25e18880-cb5c-4346-9a43-a861b07f27a8 on hv-cinder-84496 Jun 07 13:22:14.144004 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1a19a4fa-ac5a-40c1-8ff5-229a5940b698 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:14.145202 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1a19a4fa-ac5a-40c1-8ff5-229a5940b698 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:14.150242 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-025d6fcd-ebd2-4b09-91f2-26d05930c1f6 req-fdc0865b-bf88-4b6f-b129-1ed8f20f5e74 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042458 Jun 07 13:22:14.150883 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 499/1003] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:14.154771 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1a19a4fa-ac5a-40c1-8ff5-229a5940b698 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:14.155237 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1a19a4fa-ac5a-40c1-8ff5-229a5940b698 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:14.156014 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1a19a4fa-ac5a-40c1-8ff5-229a5940b698 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:14.156627 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1a19a4fa-ac5a-40c1-8ff5-229a5940b698 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:14.258782 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1a19a4fa-ac5a-40c1-8ff5-229a5940b698 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:14.267379 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1a19a4fa-ac5a-40c1-8ff5-229a5940b698 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1220 microversion: 2.1 time: 0.127167 Jun 07 13:22:14.277493 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 505/1004] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:14 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1220 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:14.317969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d3eb3a42-2a8b-4628-820b-63c9336a0beb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:14.318587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d3eb3a42-2a8b-4628-820b-63c9336a0beb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:14.325880 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d3eb3a42-2a8b-4628-820b-63c9336a0beb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:14.326663 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d3eb3a42-2a8b-4628-820b-63c9336a0beb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:14.327742 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d3eb3a42-2a8b-4628-820b-63c9336a0beb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:14.328330 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d3eb3a42-2a8b-4628-820b-63c9336a0beb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:14.555935 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d3eb3a42-2a8b-4628-820b-63c9336a0beb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:14.564843 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d3eb3a42-2a8b-4628-820b-63c9336a0beb tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1367 microversion: 2.1 time: 0.252665 Jun 07 13:22:14.565890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 500/1005] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:14 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:15.285836 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-642e0ee5-6a55-4c2d-a966-3107ae6e3097 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:15.287292 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-642e0ee5-6a55-4c2d-a966-3107ae6e3097 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:15.295059 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-642e0ee5-6a55-4c2d-a966-3107ae6e3097 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:15.295789 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-642e0ee5-6a55-4c2d-a966-3107ae6e3097 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:15.296940 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-642e0ee5-6a55-4c2d-a966-3107ae6e3097 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:15.297544 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-642e0ee5-6a55-4c2d-a966-3107ae6e3097 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:15.328137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:15.340808 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:15.583485 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-40b1a175-42ad-4ff7-8df6-f874decfa62b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:15.584664 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-40b1a175-42ad-4ff7-8df6-f874decfa62b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:15.587452 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=6 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:15.594706 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-40b1a175-42ad-4ff7-8df6-f874decfa62b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:15.595151 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-40b1a175-42ad-4ff7-8df6-f874decfa62b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:15.596128 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-40b1a175-42ad-4ff7-8df6-f874decfa62b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:15.596561 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-40b1a175-42ad-4ff7-8df6-f874decfa62b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:15.667222 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-642e0ee5-6a55-4c2d-a966-3107ae6e3097 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:15.674982 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-642e0ee5-6a55-4c2d-a966-3107ae6e3097 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1220 microversion: 2.1 time: 0.393478 Jun 07 13:22:15.686499 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 506/1006] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:15 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1220 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:15.744229 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-40b1a175-42ad-4ff7-8df6-f874decfa62b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:15.752290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-40b1a175-42ad-4ff7-8df6-f874decfa62b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1367 microversion: 2.1 time: 0.172952 Jun 07 13:22:15.753068 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 501/1007] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:15 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:22:16.693567 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d49022c0-c58a-490a-8f27-a1371804b098 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:16.694200 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d49022c0-c58a-490a-8f27-a1371804b098 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:16.700520 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d49022c0-c58a-490a-8f27-a1371804b098 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:16.701005 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d49022c0-c58a-490a-8f27-a1371804b098 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:16.701767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d49022c0-c58a-490a-8f27-a1371804b098 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:16.702196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d49022c0-c58a-490a-8f27-a1371804b098 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:16.714026 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7d858b3f-2709-4d64-bcc4-abedfc28e635 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Action: 'create', calling method: .version_select at 0x7fb8e77851f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-34190129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAggo+dlNwxEhEqYvqJYNHQLMFCfGgMwmNNJzhbQz0k7pWyN/bj+JobZhHHoqO0DMup4rq837Mr1+XPBW2VT/IIzeC56AcU1LvlWArzgaKNCB3o08k3IQ6tS2eVoViOa+Q=="}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:16.727852 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-7d858b3f-2709-4d64-bcc4-abedfc28e635 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Getting quotas for project 4a76d6db5fba43409430f5f9920c2943. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:22:16.731857 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-7d858b3f-2709-4d64-bcc4-abedfc28e635 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Getting quotas for user 010b37124c114e37966a0e22a24d5b91 and project 4a76d6db5fba43409430f5f9920c2943. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:22:16.756965 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7d858b3f-2709-4d64-bcc4-abedfc28e635 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.207060 Jun 07 13:22:16.757679 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 507/1008] 10.222.0.58 () {60 vars in 1158 bytes} [Tue Jun 7 13:22:16 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:16.769414 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d49022c0-c58a-490a-8f27-a1371804b098 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:16.769696 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-32aa4bd1-212e-4051-9c15-b4e4dba72891 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:16.770632 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-32aa4bd1-212e-4051-9c15-b4e4dba72891 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:16.780108 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d49022c0-c58a-490a-8f27-a1371804b098 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1220 microversion: 2.1 time: 0.090746 Jun 07 13:22:16.780730 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-32aa4bd1-212e-4051-9c15-b4e4dba72891 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:16.780874 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 502/1009] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:16 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:22:16.781528 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-32aa4bd1-212e-4051-9c15-b4e4dba72891 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:16.782378 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-32aa4bd1-212e-4051-9c15-b4e4dba72891 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:16.783698 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-32aa4bd1-212e-4051-9c15-b4e4dba72891 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:16.993385 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-32aa4bd1-212e-4051-9c15-b4e4dba72891 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:17.000904 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-32aa4bd1-212e-4051-9c15-b4e4dba72891 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1367 microversion: 2.1 time: 0.235433 Jun 07 13:22:17.003058 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 508/1010] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:16 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:17.797082 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-aa4d5d00-f765-4266-9127-5c6e71e30818 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:17.798227 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-aa4d5d00-f765-4266-9127-5c6e71e30818 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:17.805436 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-aa4d5d00-f765-4266-9127-5c6e71e30818 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:17.805880 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-aa4d5d00-f765-4266-9127-5c6e71e30818 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:17.807752 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-aa4d5d00-f765-4266-9127-5c6e71e30818 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:17.808463 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-aa4d5d00-f765-4266-9127-5c6e71e30818 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:17.888879 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-aa4d5d00-f765-4266-9127-5c6e71e30818 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906a40d3ab884e93a32cfca83204d34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992f495f37114f4c846ec55f37d7afd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:17.897375 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-aa4d5d00-f765-4266-9127-5c6e71e30818 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 200 len: 1220 microversion: 2.1 time: 0.104067 Jun 07 13:22:17.898338 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 503/1011] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:17 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:18.019279 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a9b5c430-bc8f-4b60-96ba-b3831083e601 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:18.019812 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a9b5c430-bc8f-4b60-96ba-b3831083e601 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:18.027353 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a9b5c430-bc8f-4b60-96ba-b3831083e601 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:18.027807 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a9b5c430-bc8f-4b60-96ba-b3831083e601 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:18.028577 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a9b5c430-bc8f-4b60-96ba-b3831083e601 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:18.029046 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a9b5c430-bc8f-4b60-96ba-b3831083e601 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:18.200400 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a9b5c430-bc8f-4b60-96ba-b3831083e601 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:18.209501 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a9b5c430-bc8f-4b60-96ba-b3831083e601 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1367 microversion: 2.1 time: 0.194715 Jun 07 13:22:18.210003 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 509/1012] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:18 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:18.915346 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7ec72c16-7003-4c6f-b7fd-a3df062fa838 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:18.916121 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7ec72c16-7003-4c6f-b7fd-a3df062fa838 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] [instance: 25e18880-cb5c-4346-9a43-a861b07f27a8] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:18.923314 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7ec72c16-7003-4c6f-b7fd-a3df062fa838 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:18.923869 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7ec72c16-7003-4c6f-b7fd-a3df062fa838 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:18.924749 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7ec72c16-7003-4c6f-b7fd-a3df062fa838 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:18.925300 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7ec72c16-7003-4c6f-b7fd-a3df062fa838 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:18.941216 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-7ec72c16-7003-4c6f-b7fd-a3df062fa838 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] HTTP exception thrown: Instance 25e18880-cb5c-4346-9a43-a861b07f27a8 could not be found. Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7ec72c16-7003-4c6f-b7fd-a3df062fa838 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Request method failure captured: Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 HTTP/1.1 Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin0-G3v-7Wd0RmGfd-yLhGbCoGYZ1MAphRnj2mTfjaL9Fxijm7EZfGBRzvY5aJIIq36x--xNcK8z0hGRu0CluE3TLwesWFUY6RE1bgbl8veYM5pvrvRk0snSOHHWgWhR6WrqXtv4-Rnvr8G8FJC7AsvFnR6CsXnB3QqPusqbi1DKI2EM Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 992f495f37114f4c846ec55f37d7afd6 Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-TestShelveInstance-1604885002 Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:22:18.943541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:22:18.945136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_992f495f37114f4c846ec55f37d7afd6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/992f495f37114f4c846ec55f37d7afd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/992f495f37114f4c846ec55f37d7afd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/992f495f37114f4c846ec55f37d7afd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:22:18.945136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-TestShelveInstance-1604885002 Jun 07 13:22:18.945136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 992f495f37114f4c846ec55f37d7afd6 Jun 07 13:22:18.945136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-TestShelveInstance-1604885002 Jun 07 13:22:18.945136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-TestShelveInstance-1604885002-project Jun 07 13:22:18.945136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:22:18.945136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:22:18.945136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 906a40d3ab884e93a32cfca83204d34f Jun 07 13:22:18.945136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-TestShelveInstance-1604885002-project Jun 07 13:22:18.945136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:22:18.945136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance 25e18880-cb5c-4346-9a43-a861b07f27a8 could not be found. Jun 07 13:22:18.945136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': '25e18880-cb5c-4346-9a43-a861b07f27a8'} Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25e18880-cb5c-4346-9a43-a861b07f27a8 could not be found. Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:18.945984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25e18880-cb5c-4346-9a43-a861b07f27a8 could not be found. Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25e18880-cb5c-4346-9a43-a861b07f27a8 could not be found. Jun 07 13:22:18.947196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.948274 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7ec72c16-7003-4c6f-b7fd-a3df062fa838 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Returning 404 to user: Instance 25e18880-cb5c-4346-9a43-a861b07f27a8 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:18.948274 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-7ec72c16-7003-4c6f-b7fd-a3df062fa838 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8" status: 404 len: 111 microversion: 2.1 time: 0.034136 Jun 07 13:22:18.948274 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 504/1013] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:18 2022] GET /compute/v2.1/servers/25e18880-cb5c-4346-9a43-a861b07f27a8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:22:19.120711 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-11749490-2ff0-4d77-bac0-88cbe49a9038 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] Calling method '.version_select at 0x7fb8e7718af0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:19.141415 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-11749490-2ff0-4d77-bac0-88cbe49a9038 tempest-TestShelveInstance-1604885002 tempest-TestShelveInstance-1604885002-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1885072570" status: 202 len: 0 microversion: 2.1 time: 0.027218 Jun 07 13:22:19.144845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 510/1014] 10.222.0.58 () {58 vars in 1253 bytes} [Tue Jun 7 13:22:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1885072570 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:22:19.229194 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-dac3fdaa-39f0-47be-b90d-d51b28b502bf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:19.230178 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-dac3fdaa-39f0-47be-b90d-d51b28b502bf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:19.236861 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dac3fdaa-39f0-47be-b90d-d51b28b502bf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:19.237512 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dac3fdaa-39f0-47be-b90d-d51b28b502bf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:19.238778 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dac3fdaa-39f0-47be-b90d-d51b28b502bf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:19.239503 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dac3fdaa-39f0-47be-b90d-d51b28b502bf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:19.477267 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-dac3fdaa-39f0-47be-b90d-d51b28b502bf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:19.487772 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-dac3fdaa-39f0-47be-b90d-d51b28b502bf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1367 microversion: 2.1 time: 0.262246 Jun 07 13:22:19.489324 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 505/1015] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:19 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:20.511959 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-21f16b55-1bd2-44c6-ad64-f4bbe1749f0d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:20.512845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-21f16b55-1bd2-44c6-ad64-f4bbe1749f0d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:20.527300 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21f16b55-1bd2-44c6-ad64-f4bbe1749f0d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:20.527914 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21f16b55-1bd2-44c6-ad64-f4bbe1749f0d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:20.528931 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21f16b55-1bd2-44c6-ad64-f4bbe1749f0d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:20.529471 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21f16b55-1bd2-44c6-ad64-f4bbe1749f0d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:20.708992 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-96b76380-3ece-43f5-8566-cbbbf45a488f req-233541b2-573e-4648-bcd9-a252f758113d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a922d01f-0f88-45e9-a764-84e36becc80b", "name": "network-vif-plugged", "status": "completed", "tag": "02ca69ec-a548-40b3-8958-bfe7e017d9c2"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:20.719176 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-21f16b55-1bd2-44c6-ad64-f4bbe1749f0d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:20.724007 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-96b76380-3ece-43f5-8566-cbbbf45a488f req-233541b2-573e-4648-bcd9-a252f758113d service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:20.725449 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-96b76380-3ece-43f5-8566-cbbbf45a488f req-233541b2-573e-4648-bcd9-a252f758113d service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:20.727591 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-21f16b55-1bd2-44c6-ad64-f4bbe1749f0d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1367 microversion: 2.1 time: 0.226133 Jun 07 13:22:20.737007 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 511/1016] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:20 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:20.749037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-96b76380-3ece-43f5-8566-cbbbf45a488f req-233541b2-573e-4648-bcd9-a252f758113d service nova] Creating event network-vif-plugged:02ca69ec-a548-40b3-8958-bfe7e017d9c2 for instance a922d01f-0f88-45e9-a764-84e36becc80b on hv-cinder-84496 Jun 07 13:22:20.760535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-96b76380-3ece-43f5-8566-cbbbf45a488f req-233541b2-573e-4648-bcd9-a252f758113d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056865 Jun 07 13:22:20.761158 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 506/1017] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:22:21.744466 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5e9ab3ab-876d-4ced-82eb-93e191aed307 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:21.745064 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5e9ab3ab-876d-4ced-82eb-93e191aed307 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:21.751401 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e9ab3ab-876d-4ced-82eb-93e191aed307 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:21.751843 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e9ab3ab-876d-4ced-82eb-93e191aed307 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:21.752791 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e9ab3ab-876d-4ced-82eb-93e191aed307 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:21.753744 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e9ab3ab-876d-4ced-82eb-93e191aed307 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:21.902637 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5e9ab3ab-876d-4ced-82eb-93e191aed307 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:21.911280 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5e9ab3ab-876d-4ced-82eb-93e191aed307 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1367 microversion: 2.1 time: 0.170762 Jun 07 13:22:21.911854 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 512/1018] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:21 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:22.068113 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-feca33bc-04e0-4486-9ba5-6ab0e8cb15ea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:22.068711 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-feca33bc-04e0-4486-9ba5-6ab0e8cb15ea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:22.076222 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-feca33bc-04e0-4486-9ba5-6ab0e8cb15ea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:22.076747 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-feca33bc-04e0-4486-9ba5-6ab0e8cb15ea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:22.077595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-feca33bc-04e0-4486-9ba5-6ab0e8cb15ea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:22.078212 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-feca33bc-04e0-4486-9ba5-6ab0e8cb15ea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:22.109698 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-feca33bc-04e0-4486-9ba5-6ab0e8cb15ea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b/ips" status: 200 len: 151 microversion: 2.20 time: 0.045954 Jun 07 13:22:22.110296 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 507/1019] 10.222.0.58 () {60 vars in 1288 bytes} [Tue Jun 7 13:22:22 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:22:22.929506 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2343ba1a-24dc-4caf-b0dd-b9ce1ec27b4c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:22.930996 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2343ba1a-24dc-4caf-b0dd-b9ce1ec27b4c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:22.937566 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2343ba1a-24dc-4caf-b0dd-b9ce1ec27b4c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:22.938160 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2343ba1a-24dc-4caf-b0dd-b9ce1ec27b4c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:22.939003 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2343ba1a-24dc-4caf-b0dd-b9ce1ec27b4c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:22.939511 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2343ba1a-24dc-4caf-b0dd-b9ce1ec27b4c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:23.215124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2343ba1a-24dc-4caf-b0dd-b9ce1ec27b4c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:23.235237 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2343ba1a-24dc-4caf-b0dd-b9ce1ec27b4c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1367 microversion: 2.1 time: 0.310656 Jun 07 13:22:23.236471 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 513/1020] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:22 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:24.253269 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1304cf7b-8aee-4353-893c-e70be9263753 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:24.254456 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1304cf7b-8aee-4353-893c-e70be9263753 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:24.260855 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1304cf7b-8aee-4353-893c-e70be9263753 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:24.261290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1304cf7b-8aee-4353-893c-e70be9263753 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:24.262045 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1304cf7b-8aee-4353-893c-e70be9263753 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:24.262499 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1304cf7b-8aee-4353-893c-e70be9263753 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:24.402984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1304cf7b-8aee-4353-893c-e70be9263753 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:24.411061 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1304cf7b-8aee-4353-893c-e70be9263753 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1557 microversion: 2.1 time: 0.161793 Jun 07 13:22:24.411642 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 508/1021] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:24 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:22:24.428784 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3cc1808e-bb74-4de4-ac9f-214fad9787da tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:24.429334 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3cc1808e-bb74-4de4-ac9f-214fad9787da tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:24.435843 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3cc1808e-bb74-4de4-ac9f-214fad9787da tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:24.436311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3cc1808e-bb74-4de4-ac9f-214fad9787da tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:24.437086 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3cc1808e-bb74-4de4-ac9f-214fad9787da tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:24.437724 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3cc1808e-bb74-4de4-ac9f-214fad9787da tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:24.538619 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3cc1808e-bb74-4de4-ac9f-214fad9787da tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114497 Jun 07 13:22:24.539672 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 514/1022] 10.222.0.58 () {58 vars in 1274 bytes} [Tue Jun 7 13:22:24 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:25.114758 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ccf5f35b-3eaa-4ed3-bf5b-56a7183826a6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:25.115932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ccf5f35b-3eaa-4ed3-bf5b-56a7183826a6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:25.134206 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ccf5f35b-3eaa-4ed3-bf5b-56a7183826a6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:25.135170 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ccf5f35b-3eaa-4ed3-bf5b-56a7183826a6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:25.136170 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ccf5f35b-3eaa-4ed3-bf5b-56a7183826a6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:25.136774 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ccf5f35b-3eaa-4ed3-bf5b-56a7183826a6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:25.167894 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-ccf5f35b-3eaa-4ed3-bf5b-56a7183826a6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lazy-loading 'flavor' on Instance uuid af7a49f1-361e-4684-9134-0ba52665297b {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:22:25.212126 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:25.561982 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ccf5f35b-3eaa-4ed3-bf5b-56a7183826a6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "POST /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b/action" status: 202 len: 0 microversion: 2.20 time: 0.452724 Jun 07 13:22:25.566900 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 509/1023] 10.222.0.58 () {62 vars in 1318 bytes} [Tue Jun 7 13:22:25 2022] POST /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:22:25.572647 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bef2908e-6250-4019-a3d3-b74e2cfc8678 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:25.574043 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bef2908e-6250-4019-a3d3-b74e2cfc8678 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:25.609448 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bef2908e-6250-4019-a3d3-b74e2cfc8678 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:25.609947 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bef2908e-6250-4019-a3d3-b74e2cfc8678 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:25.610752 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bef2908e-6250-4019-a3d3-b74e2cfc8678 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:25.611153 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bef2908e-6250-4019-a3d3-b74e2cfc8678 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:25.834185 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bef2908e-6250-4019-a3d3-b74e2cfc8678 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:25.845514 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bef2908e-6250-4019-a3d3-b74e2cfc8678 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:25.847538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bef2908e-6250-4019-a3d3-b74e2cfc8678 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:25.848715 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bef2908e-6250-4019-a3d3-b74e2cfc8678 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.281159 Jun 07 13:22:25.849816 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 515/1024] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:25 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:22:26.238491 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-c6006ad1-4db2-4f49-93e4-1462929ec84e req-1813adc3-9bca-4ac0-8bc1-b9dfda60b767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a922d01f-0f88-45e9-a764-84e36becc80b", "tag": "02ca69ec-a548-40b3-8958-bfe7e017d9c2"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:26.247729 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-c6006ad1-4db2-4f49-93e4-1462929ec84e req-1813adc3-9bca-4ac0-8bc1-b9dfda60b767 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:26.248380 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-c6006ad1-4db2-4f49-93e4-1462929ec84e req-1813adc3-9bca-4ac0-8bc1-b9dfda60b767 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:26.280757 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-c6006ad1-4db2-4f49-93e4-1462929ec84e req-1813adc3-9bca-4ac0-8bc1-b9dfda60b767 service nova] Creating event network-changed:02ca69ec-a548-40b3-8958-bfe7e017d9c2 for instance a922d01f-0f88-45e9-a764-84e36becc80b on hv-cinder-84496 Jun 07 13:22:26.286806 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-c6006ad1-4db2-4f49-93e4-1462929ec84e req-1813adc3-9bca-4ac0-8bc1-b9dfda60b767 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057206 Jun 07 13:22:26.287994 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 510/1025] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:26.868902 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bb820e7b-6209-4b1d-9028-5ca56b27e8b7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:26.869512 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bb820e7b-6209-4b1d-9028-5ca56b27e8b7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:26.871992 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=4 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:26.877507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb820e7b-6209-4b1d-9028-5ca56b27e8b7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:26.877957 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb820e7b-6209-4b1d-9028-5ca56b27e8b7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:26.878782 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb820e7b-6209-4b1d-9028-5ca56b27e8b7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:26.883296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb820e7b-6209-4b1d-9028-5ca56b27e8b7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:27.189045 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bb820e7b-6209-4b1d-9028-5ca56b27e8b7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:27.192497 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=95 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:27.199404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bb820e7b-6209-4b1d-9028-5ca56b27e8b7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:27.201144 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bb820e7b-6209-4b1d-9028-5ca56b27e8b7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:27.203024 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bb820e7b-6209-4b1d-9028-5ca56b27e8b7 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.338024 Jun 07 13:22:27.219078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 516/1026] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:26 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:28.228278 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-64dfe917-3c19-4211-9326-0d26faabd306 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:28.228869 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-64dfe917-3c19-4211-9326-0d26faabd306 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:28.235243 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-64dfe917-3c19-4211-9326-0d26faabd306 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:28.235554 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-64dfe917-3c19-4211-9326-0d26faabd306 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:28.236305 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-64dfe917-3c19-4211-9326-0d26faabd306 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:28.236736 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-64dfe917-3c19-4211-9326-0d26faabd306 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:28.369033 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-64dfe917-3c19-4211-9326-0d26faabd306 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:28.377013 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-64dfe917-3c19-4211-9326-0d26faabd306 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:28.378579 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-64dfe917-3c19-4211-9326-0d26faabd306 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:28.379729 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-64dfe917-3c19-4211-9326-0d26faabd306 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.156384 Jun 07 13:22:28.380283 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 511/1027] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:28 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:29.397739 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-35f29f6d-13ca-4a86-bfda-5db163572eae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:29.398285 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-35f29f6d-13ca-4a86-bfda-5db163572eae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:29.406768 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-35f29f6d-13ca-4a86-bfda-5db163572eae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:29.407266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-35f29f6d-13ca-4a86-bfda-5db163572eae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:29.408537 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-35f29f6d-13ca-4a86-bfda-5db163572eae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:29.409260 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-35f29f6d-13ca-4a86-bfda-5db163572eae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:29.543120 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-35f29f6d-13ca-4a86-bfda-5db163572eae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:29.551683 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-35f29f6d-13ca-4a86-bfda-5db163572eae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:29.553184 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-35f29f6d-13ca-4a86-bfda-5db163572eae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:29.554338 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-35f29f6d-13ca-4a86-bfda-5db163572eae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.160736 Jun 07 13:22:29.554932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 517/1028] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:29 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:30.572566 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-59e998e4-8e2d-4c37-a733-30af5c98f071 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:30.573111 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-59e998e4-8e2d-4c37-a733-30af5c98f071 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:30.579697 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-59e998e4-8e2d-4c37-a733-30af5c98f071 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:30.580146 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-59e998e4-8e2d-4c37-a733-30af5c98f071 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:30.580903 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-59e998e4-8e2d-4c37-a733-30af5c98f071 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:30.581341 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-59e998e4-8e2d-4c37-a733-30af5c98f071 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:30.714204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-59e998e4-8e2d-4c37-a733-30af5c98f071 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:30.722597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-59e998e4-8e2d-4c37-a733-30af5c98f071 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:30.724102 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-59e998e4-8e2d-4c37-a733-30af5c98f071 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:30.725258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-59e998e4-8e2d-4c37-a733-30af5c98f071 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.156679 Jun 07 13:22:30.726100 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 512/1029] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:30 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:31.743280 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-021a2a47-a03f-4ae8-95ac-ae8e7e39dda5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:31.743896 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-021a2a47-a03f-4ae8-95ac-ae8e7e39dda5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:31.750261 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-021a2a47-a03f-4ae8-95ac-ae8e7e39dda5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:31.750748 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-021a2a47-a03f-4ae8-95ac-ae8e7e39dda5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:31.751520 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-021a2a47-a03f-4ae8-95ac-ae8e7e39dda5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:31.751957 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-021a2a47-a03f-4ae8-95ac-ae8e7e39dda5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:31.887530 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-021a2a47-a03f-4ae8-95ac-ae8e7e39dda5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:31.896048 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-021a2a47-a03f-4ae8-95ac-ae8e7e39dda5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:31.897575 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-021a2a47-a03f-4ae8-95ac-ae8e7e39dda5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:31.898878 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-021a2a47-a03f-4ae8-95ac-ae8e7e39dda5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.159547 Jun 07 13:22:31.899437 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 518/1030] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:31 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:32.920683 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-bee4373a-8dfb-4098-a8e3-e4f54db6c1d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:32.921301 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-bee4373a-8dfb-4098-a8e3-e4f54db6c1d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:32.927611 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bee4373a-8dfb-4098-a8e3-e4f54db6c1d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:32.928064 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bee4373a-8dfb-4098-a8e3-e4f54db6c1d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:32.928831 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bee4373a-8dfb-4098-a8e3-e4f54db6c1d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:32.929270 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bee4373a-8dfb-4098-a8e3-e4f54db6c1d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:33.071961 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-bee4373a-8dfb-4098-a8e3-e4f54db6c1d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:33.080569 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-bee4373a-8dfb-4098-a8e3-e4f54db6c1d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:33.083033 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-bee4373a-8dfb-4098-a8e3-e4f54db6c1d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:33.084440 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-bee4373a-8dfb-4098-a8e3-e4f54db6c1d1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.167627 Jun 07 13:22:33.094473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 513/1031] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:32 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:34.103675 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-10413d53-5f58-412c-94b9-bfa324f7e879 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:34.104601 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-10413d53-5f58-412c-94b9-bfa324f7e879 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:34.111170 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-10413d53-5f58-412c-94b9-bfa324f7e879 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:34.111666 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-10413d53-5f58-412c-94b9-bfa324f7e879 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:34.112879 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-10413d53-5f58-412c-94b9-bfa324f7e879 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:34.113330 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-10413d53-5f58-412c-94b9-bfa324f7e879 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:34.241844 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-10413d53-5f58-412c-94b9-bfa324f7e879 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:34.249719 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-10413d53-5f58-412c-94b9-bfa324f7e879 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:34.251277 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-10413d53-5f58-412c-94b9-bfa324f7e879 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:34.252419 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-10413d53-5f58-412c-94b9-bfa324f7e879 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.152661 Jun 07 13:22:34.252984 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 519/1032] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:34 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:34.511154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-51e7c059-1645-45bb-a2e3-970c606c5777 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-582230779", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452", "networks": [{"uuid": "553d5a11-f4b5-4bc5-b12e-e8f0b81a3dfb"}]}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:34.561919 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.network.neutron [None req-51e7c059-1645-45bb-a2e3-970c606c5777 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] validate_networks() for [('553d5a11-f4b5-4bc5-b12e-e8f0b81a3dfb', None, None, None, None, None)] {{(pid=117797) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:22:34.891678 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-51e7c059-1645-45bb-a2e3-970c606c5777 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Flavor limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:22:34.892105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-51e7c059-1645-45bb-a2e3-970c606c5777 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Image limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:22:34.892581 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-51e7c059-1645-45bb-a2e3-970c606c5777 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Flavor pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:22:34.892995 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-51e7c059-1645-45bb-a2e3-970c606c5777 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Image pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:22:34.893900 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-51e7c059-1645-45bb-a2e3-970c606c5777 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:22:34.903037 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-51e7c059-1645-45bb-a2e3-970c606c5777 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:34.903489 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-51e7c059-1645-45bb-a2e3-970c606c5777 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:34.904290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-51e7c059-1645-45bb-a2e3-970c606c5777 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:34.904727 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-51e7c059-1645-45bb-a2e3-970c606c5777 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:34.923950 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-51e7c059-1645-45bb-a2e3-970c606c5777 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Getting quotas for project 14800dce94ee42638e6335472a0a46a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:22:34.927857 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-51e7c059-1645-45bb-a2e3-970c606c5777 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Getting quotas for user 2520416576534123979c732a6837a368 and project 14800dce94ee42638e6335472a0a46a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:22:34.938913 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-51e7c059-1645-45bb-a2e3-970c606c5777 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Going to run 1 instances... {{(pid=117797) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:22:34.941166 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-51e7c059-1645-45bb-a2e3-970c606c5777 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:22:34.985185 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-51e7c059-1645-45bb-a2e3-970c606c5777 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.477791 Jun 07 13:22:34.985817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 514/1033] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:22:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 13:22:34.995533 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-73e03baa-82f1-43a0-b45b-cd10ff863ecc tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:34.996140 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-73e03baa-82f1-43a0-b45b-cd10ff863ecc tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:34.997936 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:35.057154 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-73e03baa-82f1-43a0-b45b-cd10ff863ecc tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:35.063697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-73e03baa-82f1-43a0-b45b-cd10ff863ecc tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 200 len: 1218 microversion: 2.1 time: 0.071956 Jun 07 13:22:35.064260 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 520/1034] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:34 2022] GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:35.273334 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-87f629ef-315b-4f33-bbe2-cb286aff916e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:35.273334 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-87f629ef-315b-4f33-bbe2-cb286aff916e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:35.278993 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-87f629ef-315b-4f33-bbe2-cb286aff916e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:35.279900 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-87f629ef-315b-4f33-bbe2-cb286aff916e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:35.280769 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-87f629ef-315b-4f33-bbe2-cb286aff916e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:35.281306 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-87f629ef-315b-4f33-bbe2-cb286aff916e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:35.424029 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-87f629ef-315b-4f33-bbe2-cb286aff916e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:35.432788 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-87f629ef-315b-4f33-bbe2-cb286aff916e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:35.434319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-87f629ef-315b-4f33-bbe2-cb286aff916e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:35.435835 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-87f629ef-315b-4f33-bbe2-cb286aff916e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.169104 Jun 07 13:22:35.436398 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 515/1035] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:35 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:36.080999 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-12799d05-fe49-4f9d-88e5-32b788a2bbbe tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:36.083557 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-12799d05-fe49-4f9d-88e5-32b788a2bbbe tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:36.091185 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12799d05-fe49-4f9d-88e5-32b788a2bbbe tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:36.091680 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12799d05-fe49-4f9d-88e5-32b788a2bbbe tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:36.092754 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12799d05-fe49-4f9d-88e5-32b788a2bbbe tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:36.093288 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12799d05-fe49-4f9d-88e5-32b788a2bbbe tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:36.174373 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-12799d05-fe49-4f9d-88e5-32b788a2bbbe tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:36.182236 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-12799d05-fe49-4f9d-88e5-32b788a2bbbe tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 200 len: 1288 microversion: 2.1 time: 0.105172 Jun 07 13:22:36.191833 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 521/1036] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:36 2022] GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 1288 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:36.455087 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ee3c4b4b-fdce-4804-bcc7-4fbdcdf2212c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:36.455833 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ee3c4b4b-fdce-4804-bcc7-4fbdcdf2212c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:36.463056 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ee3c4b4b-fdce-4804-bcc7-4fbdcdf2212c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:36.463506 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ee3c4b4b-fdce-4804-bcc7-4fbdcdf2212c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:36.464289 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ee3c4b4b-fdce-4804-bcc7-4fbdcdf2212c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:36.464718 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ee3c4b4b-fdce-4804-bcc7-4fbdcdf2212c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:36.608892 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ee3c4b4b-fdce-4804-bcc7-4fbdcdf2212c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:36.618870 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ee3c4b4b-fdce-4804-bcc7-4fbdcdf2212c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:36.620379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ee3c4b4b-fdce-4804-bcc7-4fbdcdf2212c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:36.621552 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ee3c4b4b-fdce-4804-bcc7-4fbdcdf2212c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.170508 Jun 07 13:22:36.622119 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 516/1037] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:36 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:37.200802 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9f52ace7-b11d-4203-a43e-5fb034ea3a35 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:37.201558 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9f52ace7-b11d-4203-a43e-5fb034ea3a35 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:37.208614 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9f52ace7-b11d-4203-a43e-5fb034ea3a35 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:37.209104 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9f52ace7-b11d-4203-a43e-5fb034ea3a35 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:37.209868 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9f52ace7-b11d-4203-a43e-5fb034ea3a35 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:37.210345 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9f52ace7-b11d-4203-a43e-5fb034ea3a35 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:37.412116 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9f52ace7-b11d-4203-a43e-5fb034ea3a35 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:37.419651 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9f52ace7-b11d-4203-a43e-5fb034ea3a35 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 200 len: 1318 microversion: 2.1 time: 0.222944 Jun 07 13:22:37.420315 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 522/1038] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:37 2022] GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:37.492445 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-941d570d-177c-4af4-9324-74fdae7c8286 req-4abe6abb-083d-48b2-9449-bfca0b6e0ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20142887-e2ee-41f7-ad62-2e938b3c36f9", "tag": "6dfd74be-2c6a-41c1-ae2f-f16d2f21a144"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:37.501161 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-941d570d-177c-4af4-9324-74fdae7c8286 req-4abe6abb-083d-48b2-9449-bfca0b6e0ca8 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:37.501997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-941d570d-177c-4af4-9324-74fdae7c8286 req-4abe6abb-083d-48b2-9449-bfca0b6e0ca8 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:37.514372 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-941d570d-177c-4af4-9324-74fdae7c8286 req-4abe6abb-083d-48b2-9449-bfca0b6e0ca8 service nova] Creating event network-changed:6dfd74be-2c6a-41c1-ae2f-f16d2f21a144 for instance 20142887-e2ee-41f7-ad62-2e938b3c36f9 on hv-cinder-84496 Jun 07 13:22:37.519785 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-941d570d-177c-4af4-9324-74fdae7c8286 req-4abe6abb-083d-48b2-9449-bfca0b6e0ca8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031089 Jun 07 13:22:37.520508 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 517/1039] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:37.640227 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-baca4f9a-48f5-44a8-8236-fa7d96e67ca4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:37.641003 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-baca4f9a-48f5-44a8-8236-fa7d96e67ca4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:37.647160 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-baca4f9a-48f5-44a8-8236-fa7d96e67ca4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:37.647608 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-baca4f9a-48f5-44a8-8236-fa7d96e67ca4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:37.648374 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-baca4f9a-48f5-44a8-8236-fa7d96e67ca4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:37.648808 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-baca4f9a-48f5-44a8-8236-fa7d96e67ca4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:37.871153 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-baca4f9a-48f5-44a8-8236-fa7d96e67ca4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:37.879737 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-baca4f9a-48f5-44a8-8236-fa7d96e67ca4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:37.881237 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-baca4f9a-48f5-44a8-8236-fa7d96e67ca4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:37.882395 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-baca4f9a-48f5-44a8-8236-fa7d96e67ca4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.246360 Jun 07 13:22:37.882978 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 523/1040] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:37 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:38.437157 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8770ccfd-b7e2-4449-ac80-2d03b77b7f97 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:38.437894 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8770ccfd-b7e2-4449-ac80-2d03b77b7f97 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:38.444337 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8770ccfd-b7e2-4449-ac80-2d03b77b7f97 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:38.444793 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8770ccfd-b7e2-4449-ac80-2d03b77b7f97 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:38.445567 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8770ccfd-b7e2-4449-ac80-2d03b77b7f97 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:38.446012 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8770ccfd-b7e2-4449-ac80-2d03b77b7f97 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:38.583554 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8770ccfd-b7e2-4449-ac80-2d03b77b7f97 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:38.591127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8770ccfd-b7e2-4449-ac80-2d03b77b7f97 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 200 len: 1318 microversion: 2.1 time: 0.158260 Jun 07 13:22:38.591688 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 518/1041] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:38 2022] GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:38.900769 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-62d16691-1196-4e0a-9980-1d74273eacbd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:38.901642 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-62d16691-1196-4e0a-9980-1d74273eacbd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:38.908166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-62d16691-1196-4e0a-9980-1d74273eacbd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:38.908614 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-62d16691-1196-4e0a-9980-1d74273eacbd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:38.909379 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-62d16691-1196-4e0a-9980-1d74273eacbd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:38.909817 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-62d16691-1196-4e0a-9980-1d74273eacbd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:39.035064 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-62d16691-1196-4e0a-9980-1d74273eacbd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:39.042988 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-62d16691-1196-4e0a-9980-1d74273eacbd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:39.044502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-62d16691-1196-4e0a-9980-1d74273eacbd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:39.045655 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-62d16691-1196-4e0a-9980-1d74273eacbd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.148957 Jun 07 13:22:39.046218 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 524/1042] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:38 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:39.608404 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b2893b42-7c3e-4190-85d5-527d897ab905 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:39.609139 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b2893b42-7c3e-4190-85d5-527d897ab905 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:39.616218 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b2893b42-7c3e-4190-85d5-527d897ab905 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:39.616665 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b2893b42-7c3e-4190-85d5-527d897ab905 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:39.617423 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b2893b42-7c3e-4190-85d5-527d897ab905 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:39.617858 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b2893b42-7c3e-4190-85d5-527d897ab905 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:39.746020 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b2893b42-7c3e-4190-85d5-527d897ab905 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:39.753419 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b2893b42-7c3e-4190-85d5-527d897ab905 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 200 len: 1318 microversion: 2.1 time: 0.148927 Jun 07 13:22:39.753980 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 519/1043] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:39 2022] GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:40.064176 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bb6e12d5-a081-461f-be65-a06baaa24f95 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:40.064701 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bb6e12d5-a081-461f-be65-a06baaa24f95 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:40.071198 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb6e12d5-a081-461f-be65-a06baaa24f95 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:40.071642 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb6e12d5-a081-461f-be65-a06baaa24f95 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:40.072388 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb6e12d5-a081-461f-be65-a06baaa24f95 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:40.072821 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb6e12d5-a081-461f-be65-a06baaa24f95 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:40.201027 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bb6e12d5-a081-461f-be65-a06baaa24f95 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:40.209500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bb6e12d5-a081-461f-be65-a06baaa24f95 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:40.211083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bb6e12d5-a081-461f-be65-a06baaa24f95 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:40.212234 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bb6e12d5-a081-461f-be65-a06baaa24f95 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.152052 Jun 07 13:22:40.212792 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 525/1044] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:40 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:40.770210 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a151e9d2-a491-4ca0-bee6-717df3a4e49c tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:40.770769 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a151e9d2-a491-4ca0-bee6-717df3a4e49c tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:40.777437 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a151e9d2-a491-4ca0-bee6-717df3a4e49c tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:40.777893 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a151e9d2-a491-4ca0-bee6-717df3a4e49c tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:40.778689 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a151e9d2-a491-4ca0-bee6-717df3a4e49c tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:40.779125 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a151e9d2-a491-4ca0-bee6-717df3a4e49c tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:40.909463 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a151e9d2-a491-4ca0-bee6-717df3a4e49c tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:40.916835 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a151e9d2-a491-4ca0-bee6-717df3a4e49c tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 200 len: 1318 microversion: 2.1 time: 0.150680 Jun 07 13:22:40.917399 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 520/1045] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:40 2022] GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:41.230836 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-20283be3-217d-471f-b146-8487135b979b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:41.231447 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-20283be3-217d-471f-b146-8487135b979b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:41.238674 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20283be3-217d-471f-b146-8487135b979b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:41.239122 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20283be3-217d-471f-b146-8487135b979b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:41.239875 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20283be3-217d-471f-b146-8487135b979b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:41.240310 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20283be3-217d-471f-b146-8487135b979b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:41.365613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-20283be3-217d-471f-b146-8487135b979b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:41.373475 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-20283be3-217d-471f-b146-8487135b979b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:41.375010 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-20283be3-217d-471f-b146-8487135b979b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:41.376160 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-20283be3-217d-471f-b146-8487135b979b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.149208 Jun 07 13:22:41.376743 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 526/1046] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:41 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:41.934154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f5bb379c-8dd0-4167-8c00-cf7a94089bf2 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:41.934794 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f5bb379c-8dd0-4167-8c00-cf7a94089bf2 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:41.941806 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f5bb379c-8dd0-4167-8c00-cf7a94089bf2 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:41.942262 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f5bb379c-8dd0-4167-8c00-cf7a94089bf2 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:41.943048 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f5bb379c-8dd0-4167-8c00-cf7a94089bf2 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:41.943486 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f5bb379c-8dd0-4167-8c00-cf7a94089bf2 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:42.069839 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f5bb379c-8dd0-4167-8c00-cf7a94089bf2 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:42.077344 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f5bb379c-8dd0-4167-8c00-cf7a94089bf2 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 200 len: 1318 microversion: 2.1 time: 0.147046 Jun 07 13:22:42.077909 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 521/1047] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:41 2022] GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:42.394547 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-50b5f360-150b-4955-8884-0267651d1c32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:42.395188 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-50b5f360-150b-4955-8884-0267651d1c32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:42.401616 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-50b5f360-150b-4955-8884-0267651d1c32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:42.402070 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-50b5f360-150b-4955-8884-0267651d1c32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:42.402954 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-50b5f360-150b-4955-8884-0267651d1c32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:42.403344 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-50b5f360-150b-4955-8884-0267651d1c32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:42.604466 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-50b5f360-150b-4955-8884-0267651d1c32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:42.619064 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-50b5f360-150b-4955-8884-0267651d1c32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:42.620934 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-50b5f360-150b-4955-8884-0267651d1c32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:42.622985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-50b5f360-150b-4955-8884-0267651d1c32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.232357 Jun 07 13:22:42.634514 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 527/1048] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:42 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:42.784970 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-87e9c5ea-fd6a-4547-87dc-1e69a725c7bd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2101857388", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-34190129", "security_groups": [{"name": "tempest-secgroup-smoke-1052045060"}], "block_device_mapping_v2": [{"uuid": "5d89c8aa-25bc-430f-8d4f-dd4c048d93d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "740c525e-9834-4cf4-9b2c-18b2382f4e9c"}]}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:42.902819 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.network.neutron [None req-87e9c5ea-fd6a-4547-87dc-1e69a725c7bd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] validate_networks() for [('740c525e-9834-4cf4-9b2c-18b2382f4e9c', None, None, None, None, None)] {{(pid=117797) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:22:43.072783 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:43.094336 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-391decfe-50be-4bad-977f-c0733ca9414d tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:43.095014 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-391decfe-50be-4bad-977f-c0733ca9414d tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:43.100919 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-391decfe-50be-4bad-977f-c0733ca9414d tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:43.101369 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-391decfe-50be-4bad-977f-c0733ca9414d tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:43.102137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-391decfe-50be-4bad-977f-c0733ca9414d tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:43.102607 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-391decfe-50be-4bad-977f-c0733ca9414d tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:43.230316 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-391decfe-50be-4bad-977f-c0733ca9414d tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:43.238238 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-391decfe-50be-4bad-977f-c0733ca9414d tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 200 len: 1318 microversion: 2.1 time: 0.147711 Jun 07 13:22:43.238860 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 528/1049] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:43 2022] GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:22:43.260634 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-87e9c5ea-fd6a-4547-87dc-1e69a725c7bd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Flavor limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:22:43.261062 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-87e9c5ea-fd6a-4547-87dc-1e69a725c7bd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Image limits 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:22:43.261536 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-87e9c5ea-fd6a-4547-87dc-1e69a725c7bd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Flavor pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:22:43.261944 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-87e9c5ea-fd6a-4547-87dc-1e69a725c7bd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Image pref 0:0:0 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:22:43.262352 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.virt.hardware [None req-87e9c5ea-fd6a-4547-87dc-1e69a725c7bd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:22:43.271276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-87e9c5ea-fd6a-4547-87dc-1e69a725c7bd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:43.271721 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-87e9c5ea-fd6a-4547-87dc-1e69a725c7bd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:43.272511 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-87e9c5ea-fd6a-4547-87dc-1e69a725c7bd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:43.272947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-87e9c5ea-fd6a-4547-87dc-1e69a725c7bd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:43.290200 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-87e9c5ea-fd6a-4547-87dc-1e69a725c7bd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Getting quotas for project 4a76d6db5fba43409430f5f9920c2943. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:22:43.294128 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.quota [None req-87e9c5ea-fd6a-4547-87dc-1e69a725c7bd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Getting quotas for user 010b37124c114e37966a0e22a24d5b91 and project 4a76d6db5fba43409430f5f9920c2943. Resources: {'instances', 'ram', 'cores'} {{(pid=117797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:22:43.350235 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-87e9c5ea-fd6a-4547-87dc-1e69a725c7bd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Going to run 1 instances... {{(pid=117797) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:22:43.352359 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-87e9c5ea-fd6a-4547-87dc-1e69a725c7bd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d89c8aa-25bc-430f-8d4f-dd4c048d93d8',volume_size=None,volume_type=None)] {{(pid=117797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:22:43.476994 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-87e9c5ea-fd6a-4547-87dc-1e69a725c7bd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.695845 Jun 07 13:22:43.477628 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 522/1050] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:22:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:22:43.488089 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-39fa0beb-fa9e-4735-bf29-b03f1966b6c0 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:43.488745 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-39fa0beb-fa9e-4735-bf29-b03f1966b6c0 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:43.541593 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-39fa0beb-fa9e-4735-bf29-b03f1966b6c0 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:43.548452 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-39fa0beb-fa9e-4735-bf29-b03f1966b6c0 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1093 microversion: 2.1 time: 0.064687 Jun 07 13:22:43.549015 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 529/1051] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:43 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:43.641553 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-6a6df714-7362-4b40-930e-348e26c66566 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:43.642158 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-6a6df714-7362-4b40-930e-348e26c66566 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:43.649499 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6a6df714-7362-4b40-930e-348e26c66566 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:43.650006 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6a6df714-7362-4b40-930e-348e26c66566 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:43.651152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6a6df714-7362-4b40-930e-348e26c66566 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:43.651651 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6a6df714-7362-4b40-930e-348e26c66566 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:43.787670 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-6a6df714-7362-4b40-930e-348e26c66566 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:43.795800 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-6a6df714-7362-4b40-930e-348e26c66566 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:43.797287 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-6a6df714-7362-4b40-930e-348e26c66566 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:43.798570 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-6a6df714-7362-4b40-930e-348e26c66566 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1744 microversion: 2.20 time: 0.161216 Jun 07 13:22:43.809104 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 523/1052] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:43 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:44.254861 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-83643e0c-fc66-46b0-8841-f831fad318f2 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:44.255395 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-83643e0c-fc66-46b0-8841-f831fad318f2 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:44.262274 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-83643e0c-fc66-46b0-8841-f831fad318f2 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:44.262766 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-83643e0c-fc66-46b0-8841-f831fad318f2 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:44.263539 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-83643e0c-fc66-46b0-8841-f831fad318f2 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:44.263983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-83643e0c-fc66-46b0-8841-f831fad318f2 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:44.391004 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-83643e0c-fc66-46b0-8841-f831fad318f2 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:44.398327 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-83643e0c-fc66-46b0-8841-f831fad318f2 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 200 len: 1318 microversion: 2.1 time: 0.147969 Jun 07 13:22:44.398917 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 530/1053] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:44 2022] GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:44.566530 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7fa69feb-81bc-432c-af98-8b1afbb7711d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:44.567089 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7fa69feb-81bc-432c-af98-8b1afbb7711d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:44.574122 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7fa69feb-81bc-432c-af98-8b1afbb7711d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:44.574610 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7fa69feb-81bc-432c-af98-8b1afbb7711d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:44.575378 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7fa69feb-81bc-432c-af98-8b1afbb7711d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:44.575819 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7fa69feb-81bc-432c-af98-8b1afbb7711d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:44.637875 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-7fa69feb-81bc-432c-af98-8b1afbb7711d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:44.646313 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-7fa69feb-81bc-432c-af98-8b1afbb7711d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1191 microversion: 2.1 time: 0.084304 Jun 07 13:22:44.646984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 524/1054] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:44 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:44.816697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d206f107-419c-4a3c-a2c9-c76fb92396b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:44.817252 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d206f107-419c-4a3c-a2c9-c76fb92396b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:44.823948 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d206f107-419c-4a3c-a2c9-c76fb92396b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:44.824726 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d206f107-419c-4a3c-a2c9-c76fb92396b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:44.825716 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d206f107-419c-4a3c-a2c9-c76fb92396b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:44.826305 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d206f107-419c-4a3c-a2c9-c76fb92396b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:45.068134 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d206f107-419c-4a3c-a2c9-c76fb92396b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:45.077802 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d206f107-419c-4a3c-a2c9-c76fb92396b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:45.079689 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d206f107-419c-4a3c-a2c9-c76fb92396b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:45.081611 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d206f107-419c-4a3c-a2c9-c76fb92396b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1744 microversion: 2.20 time: 0.269356 Jun 07 13:22:45.082266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 531/1055] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:44 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1744 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:45.153904 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-93defd18-794e-4826-84f3-c0178dd5720d req-3d514436-e5bc-4346-a70c-0196de36ce94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20142887-e2ee-41f7-ad62-2e938b3c36f9", "name": "network-vif-plugged", "status": "completed", "tag": "6dfd74be-2c6a-41c1-ae2f-f16d2f21a144"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:45.163282 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-93defd18-794e-4826-84f3-c0178dd5720d req-3d514436-e5bc-4346-a70c-0196de36ce94 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:45.163729 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-93defd18-794e-4826-84f3-c0178dd5720d req-3d514436-e5bc-4346-a70c-0196de36ce94 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:45.176726 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-93defd18-794e-4826-84f3-c0178dd5720d req-3d514436-e5bc-4346-a70c-0196de36ce94 service nova] Creating event network-vif-plugged:6dfd74be-2c6a-41c1-ae2f-f16d2f21a144 for instance 20142887-e2ee-41f7-ad62-2e938b3c36f9 on hv-cinder-84496 Jun 07 13:22:45.181999 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-93defd18-794e-4826-84f3-c0178dd5720d req-3d514436-e5bc-4346-a70c-0196de36ce94 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031978 Jun 07 13:22:45.183180 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 525/1056] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:45.417891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9d8e9e6f-a37c-47ac-ad3f-d85b3f8e4980 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:45.417891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9d8e9e6f-a37c-47ac-ad3f-d85b3f8e4980 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:45.426417 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9d8e9e6f-a37c-47ac-ad3f-d85b3f8e4980 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:45.427001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9d8e9e6f-a37c-47ac-ad3f-d85b3f8e4980 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:45.428978 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9d8e9e6f-a37c-47ac-ad3f-d85b3f8e4980 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:45.428978 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9d8e9e6f-a37c-47ac-ad3f-d85b3f8e4980 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:45.666562 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-73108f1a-ead2-4c95-8721-a3ee780a24b2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:45.668041 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-73108f1a-ead2-4c95-8721-a3ee780a24b2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:45.677057 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-73108f1a-ead2-4c95-8721-a3ee780a24b2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:45.677515 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-73108f1a-ead2-4c95-8721-a3ee780a24b2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:45.678300 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-73108f1a-ead2-4c95-8721-a3ee780a24b2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:45.678961 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-73108f1a-ead2-4c95-8721-a3ee780a24b2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:45.734340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9d8e9e6f-a37c-47ac-ad3f-d85b3f8e4980 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:45.742959 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9d8e9e6f-a37c-47ac-ad3f-d85b3f8e4980 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 200 len: 1318 microversion: 2.1 time: 0.331231 Jun 07 13:22:45.743995 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 532/1057] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:45 2022] GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:45.820377 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-73108f1a-ead2-4c95-8721-a3ee780a24b2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:45.827994 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-73108f1a-ead2-4c95-8721-a3ee780a24b2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1265 microversion: 2.1 time: 0.166903 Jun 07 13:22:45.828949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 526/1058] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:45 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:22:46.100553 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6f1fd2c8-2d3d-4613-ae01-7b65625e3114 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:46.101159 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6f1fd2c8-2d3d-4613-ae01-7b65625e3114 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:46.107580 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6f1fd2c8-2d3d-4613-ae01-7b65625e3114 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:46.108028 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6f1fd2c8-2d3d-4613-ae01-7b65625e3114 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:46.108783 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6f1fd2c8-2d3d-4613-ae01-7b65625e3114 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:46.109208 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6f1fd2c8-2d3d-4613-ae01-7b65625e3114 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:46.313922 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6f1fd2c8-2d3d-4613-ae01-7b65625e3114 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:46.322468 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6f1fd2c8-2d3d-4613-ae01-7b65625e3114 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:46.324030 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6f1fd2c8-2d3d-4613-ae01-7b65625e3114 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:46.325195 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6f1fd2c8-2d3d-4613-ae01-7b65625e3114 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1744 microversion: 2.20 time: 0.229182 Jun 07 13:22:46.325761 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 533/1059] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:46 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1744 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:46.759851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c84ab29f-1df5-471e-99b2-f6adbe917797 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:46.760608 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c84ab29f-1df5-471e-99b2-f6adbe917797 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:46.767699 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c84ab29f-1df5-471e-99b2-f6adbe917797 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:46.768547 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c84ab29f-1df5-471e-99b2-f6adbe917797 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:46.769761 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c84ab29f-1df5-471e-99b2-f6adbe917797 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:46.770338 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c84ab29f-1df5-471e-99b2-f6adbe917797 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:46.834049 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-3296803c-1b9a-427e-aab6-e055e6ae10be req-fc39a92b-03b7-4729-aa0f-7c70e43c0179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f62c387-9b2e-4a04-bcf7-db7d688bd6f2", "tag": "93ee244b-dc39-4f08-b0be-acd8a2ab021d"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:46.870079 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-3296803c-1b9a-427e-aab6-e055e6ae10be req-fc39a92b-03b7-4729-aa0f-7c70e43c0179 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:46.871612 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-3296803c-1b9a-427e-aab6-e055e6ae10be req-fc39a92b-03b7-4729-aa0f-7c70e43c0179 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:46.887707 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-3296803c-1b9a-427e-aab6-e055e6ae10be req-fc39a92b-03b7-4729-aa0f-7c70e43c0179 service nova] Creating event network-changed:93ee244b-dc39-4f08-b0be-acd8a2ab021d for instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 on hv-cinder-84496 Jun 07 13:22:46.902215 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-3296803c-1b9a-427e-aab6-e055e6ae10be req-fc39a92b-03b7-4729-aa0f-7c70e43c0179 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078371 Jun 07 13:22:46.905888 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 534/1060] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:46.913123 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-24aca058-2ba5-45cc-89a5-6fabbad761a4 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:46.913833 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-24aca058-2ba5-45cc-89a5-6fabbad761a4 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:46.921328 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-24aca058-2ba5-45cc-89a5-6fabbad761a4 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:46.922126 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-24aca058-2ba5-45cc-89a5-6fabbad761a4 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:46.923146 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-24aca058-2ba5-45cc-89a5-6fabbad761a4 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:46.923883 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-24aca058-2ba5-45cc-89a5-6fabbad761a4 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:46.947429 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c84ab29f-1df5-471e-99b2-f6adbe917797 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:46.967368 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c84ab29f-1df5-471e-99b2-f6adbe917797 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 200 len: 1318 microversion: 2.1 time: 0.211159 Jun 07 13:22:46.968530 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 527/1061] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:46 2022] GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:47.198136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-a9ec49bc-4432-4563-831b-243fa8b464e4 req-eee160e2-ad5c-4b59-bce2-2265c798a579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7a49f1-361e-4684-9134-0ba52665297b", "name": "network-vif-plugged", "status": "completed", "tag": "5cbf5f8c-af01-4a2e-8f16-dd54822bb4cd"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:47.207215 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-a9ec49bc-4432-4563-831b-243fa8b464e4 req-eee160e2-ad5c-4b59-bce2-2265c798a579 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:47.207660 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-a9ec49bc-4432-4563-831b-243fa8b464e4 req-eee160e2-ad5c-4b59-bce2-2265c798a579 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:47.210797 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:47.221606 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-a9ec49bc-4432-4563-831b-243fa8b464e4 req-eee160e2-ad5c-4b59-bce2-2265c798a579 service nova] Creating event network-vif-plugged:5cbf5f8c-af01-4a2e-8f16-dd54822bb4cd for instance af7a49f1-361e-4684-9134-0ba52665297b on hv-cinder-84496 Jun 07 13:22:47.227106 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-a9ec49bc-4432-4563-831b-243fa8b464e4 req-eee160e2-ad5c-4b59-bce2-2265c798a579 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032733 Jun 07 13:22:47.227711 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 528/1062] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:22:47.344749 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-cf3003c0-0620-4fd7-a980-a01d059a8bee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:47.345571 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-cf3003c0-0620-4fd7-a980-a01d059a8bee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:47.352042 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cf3003c0-0620-4fd7-a980-a01d059a8bee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:47.352493 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cf3003c0-0620-4fd7-a980-a01d059a8bee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:47.352669 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-24aca058-2ba5-45cc-89a5-6fabbad761a4 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:47.353260 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cf3003c0-0620-4fd7-a980-a01d059a8bee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:47.353702 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-cf3003c0-0620-4fd7-a980-a01d059a8bee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:47.360306 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-24aca058-2ba5-45cc-89a5-6fabbad761a4 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1265 microversion: 2.1 time: 0.453127 Jun 07 13:22:47.360880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 535/1063] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:46 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1265 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:47.482175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cf3003c0-0620-4fd7-a980-a01d059a8bee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:47.490480 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cf3003c0-0620-4fd7-a980-a01d059a8bee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:47.491973 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cf3003c0-0620-4fd7-a980-a01d059a8bee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:47.493112 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-cf3003c0-0620-4fd7-a980-a01d059a8bee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1744 microversion: 2.20 time: 0.152975 Jun 07 13:22:47.493662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 529/1064] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:47 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:22:47.985175 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-df83128e-c7d8-4ee9-ba61-80ccdfaf08d9 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:47.988123 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-df83128e-c7d8-4ee9-ba61-80ccdfaf08d9 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:47.993122 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-df83128e-c7d8-4ee9-ba61-80ccdfaf08d9 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:47.993561 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-df83128e-c7d8-4ee9-ba61-80ccdfaf08d9 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:47.994327 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-df83128e-c7d8-4ee9-ba61-80ccdfaf08d9 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:47.994781 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-df83128e-c7d8-4ee9-ba61-80ccdfaf08d9 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:47.999103 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:48.209176 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-df83128e-c7d8-4ee9-ba61-80ccdfaf08d9 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:48.216948 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-df83128e-c7d8-4ee9-ba61-80ccdfaf08d9 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 200 len: 1507 microversion: 2.1 time: 0.235800 Jun 07 13:22:48.217614 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 536/1065] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:47 2022] GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 1507 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:48.376999 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b9da4b1f-0d16-4a7f-b0d3-e7bbdb970dbf tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:48.377663 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b9da4b1f-0d16-4a7f-b0d3-e7bbdb970dbf tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:48.384469 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b9da4b1f-0d16-4a7f-b0d3-e7bbdb970dbf tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:48.384929 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b9da4b1f-0d16-4a7f-b0d3-e7bbdb970dbf tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:48.385698 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b9da4b1f-0d16-4a7f-b0d3-e7bbdb970dbf tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:48.386138 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b9da4b1f-0d16-4a7f-b0d3-e7bbdb970dbf tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:48.518988 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8a88901c-93b2-427e-abe6-f8929cdf7e77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:48.520036 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8a88901c-93b2-427e-abe6-f8929cdf7e77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:48.526279 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b9da4b1f-0d16-4a7f-b0d3-e7bbdb970dbf tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:48.532941 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a88901c-93b2-427e-abe6-f8929cdf7e77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:48.533390 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a88901c-93b2-427e-abe6-f8929cdf7e77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:48.534529 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a88901c-93b2-427e-abe6-f8929cdf7e77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:48.535160 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a88901c-93b2-427e-abe6-f8929cdf7e77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:48.536752 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b9da4b1f-0d16-4a7f-b0d3-e7bbdb970dbf tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1265 microversion: 2.1 time: 0.163198 Jun 07 13:22:48.537879 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 530/1066] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:48 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:48.685906 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8a88901c-93b2-427e-abe6-f8929cdf7e77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:48.694899 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8a88901c-93b2-427e-abe6-f8929cdf7e77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:48.696551 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8a88901c-93b2-427e-abe6-f8929cdf7e77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:48.697732 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8a88901c-93b2-427e-abe6-f8929cdf7e77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1744 microversion: 2.20 time: 0.188450 Jun 07 13:22:48.698284 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 537/1067] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:48 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1744 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:22:49.554026 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b4f1f271-b368-4fc8-b426-302915343278 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:49.554671 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b4f1f271-b368-4fc8-b426-302915343278 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:49.561108 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b4f1f271-b368-4fc8-b426-302915343278 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:49.561555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b4f1f271-b368-4fc8-b426-302915343278 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:49.562308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b4f1f271-b368-4fc8-b426-302915343278 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:49.562770 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b4f1f271-b368-4fc8-b426-302915343278 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:49.702228 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b4f1f271-b368-4fc8-b426-302915343278 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:49.709839 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b4f1f271-b368-4fc8-b426-302915343278 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1265 microversion: 2.1 time: 0.159617 Jun 07 13:22:49.710792 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 531/1068] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:49 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:49.725365 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ed683c5d-1dd1-4e23-92c0-a7daa303c029 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:49.726046 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ed683c5d-1dd1-4e23-92c0-a7daa303c029 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:49.732478 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed683c5d-1dd1-4e23-92c0-a7daa303c029 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:49.732920 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed683c5d-1dd1-4e23-92c0-a7daa303c029 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:49.733714 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed683c5d-1dd1-4e23-92c0-a7daa303c029 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:49.734146 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed683c5d-1dd1-4e23-92c0-a7daa303c029 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:49.862132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ed683c5d-1dd1-4e23-92c0-a7daa303c029 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:49.870280 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ed683c5d-1dd1-4e23-92c0-a7daa303c029 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:49.872008 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ed683c5d-1dd1-4e23-92c0-a7daa303c029 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:49.873177 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ed683c5d-1dd1-4e23-92c0-a7daa303c029 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1744 microversion: 2.20 time: 0.151878 Jun 07 13:22:49.873741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 538/1069] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:49 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:50.727979 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b48e4048-8237-499a-8bb3-33e7b9502a66 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:50.728682 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b48e4048-8237-499a-8bb3-33e7b9502a66 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:50.735268 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b48e4048-8237-499a-8bb3-33e7b9502a66 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:50.735663 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b48e4048-8237-499a-8bb3-33e7b9502a66 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:50.736425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b48e4048-8237-499a-8bb3-33e7b9502a66 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:50.736919 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b48e4048-8237-499a-8bb3-33e7b9502a66 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:50.868134 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b48e4048-8237-499a-8bb3-33e7b9502a66 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:50.875745 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b48e4048-8237-499a-8bb3-33e7b9502a66 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1265 microversion: 2.1 time: 0.151577 Jun 07 13:22:50.876320 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 532/1070] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:50 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:50.893376 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-366c6f11-2315-441f-97c6-9aa376c580cb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:50.894666 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-366c6f11-2315-441f-97c6-9aa376c580cb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:50.901608 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-366c6f11-2315-441f-97c6-9aa376c580cb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:50.902062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-366c6f11-2315-441f-97c6-9aa376c580cb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:50.902874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-366c6f11-2315-441f-97c6-9aa376c580cb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:50.903316 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-366c6f11-2315-441f-97c6-9aa376c580cb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:51.110510 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-366c6f11-2315-441f-97c6-9aa376c580cb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:51.118867 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-366c6f11-2315-441f-97c6-9aa376c580cb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:51.120382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-366c6f11-2315-441f-97c6-9aa376c580cb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:51.121545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-366c6f11-2315-441f-97c6-9aa376c580cb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1744 microversion: 2.20 time: 0.233374 Jun 07 13:22:51.122097 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 539/1071] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:50 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1744 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:51.893300 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-268f8171-a42c-45b2-bd7d-9ce38f6fd3a1 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:51.894028 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-268f8171-a42c-45b2-bd7d-9ce38f6fd3a1 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:51.900961 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-268f8171-a42c-45b2-bd7d-9ce38f6fd3a1 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:51.901484 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-268f8171-a42c-45b2-bd7d-9ce38f6fd3a1 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:51.902247 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-268f8171-a42c-45b2-bd7d-9ce38f6fd3a1 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:51.902706 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-268f8171-a42c-45b2-bd7d-9ce38f6fd3a1 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:52.140936 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-792f89de-4eb0-4d59-a1e3-56bde7d0637f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:52.141554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-792f89de-4eb0-4d59-a1e3-56bde7d0637f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:52.152314 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-792f89de-4eb0-4d59-a1e3-56bde7d0637f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:52.152829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-792f89de-4eb0-4d59-a1e3-56bde7d0637f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:52.153665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-792f89de-4eb0-4d59-a1e3-56bde7d0637f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:52.154135 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-792f89de-4eb0-4d59-a1e3-56bde7d0637f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:52.337776 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-792f89de-4eb0-4d59-a1e3-56bde7d0637f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:52.354050 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-792f89de-4eb0-4d59-a1e3-56bde7d0637f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:52.355852 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-792f89de-4eb0-4d59-a1e3-56bde7d0637f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:52.357797 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-792f89de-4eb0-4d59-a1e3-56bde7d0637f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1739 microversion: 2.20 time: 0.220337 Jun 07 13:22:52.359812 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 540/1072] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:52 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:22:52.374779 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-268f8171-a42c-45b2-bd7d-9ce38f6fd3a1 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:52.386308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-268f8171-a42c-45b2-bd7d-9ce38f6fd3a1 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1265 microversion: 2.1 time: 0.497297 Jun 07 13:22:52.389136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 533/1073] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:51 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1265 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:53.377122 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-45f038f1-42fd-44a1-8845-58d7ebe0711d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:53.377730 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-45f038f1-42fd-44a1-8845-58d7ebe0711d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:53.385634 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-45f038f1-42fd-44a1-8845-58d7ebe0711d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:53.386114 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-45f038f1-42fd-44a1-8845-58d7ebe0711d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:53.387239 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-45f038f1-42fd-44a1-8845-58d7ebe0711d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:53.387678 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-45f038f1-42fd-44a1-8845-58d7ebe0711d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:53.403751 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-39aa11bd-4038-441c-8501-217950de5b6f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:53.404361 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-39aa11bd-4038-441c-8501-217950de5b6f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:53.407999 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=4 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:53.411486 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=12 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:53.423752 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39aa11bd-4038-441c-8501-217950de5b6f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:53.424222 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39aa11bd-4038-441c-8501-217950de5b6f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:53.425036 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39aa11bd-4038-441c-8501-217950de5b6f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:53.425489 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-39aa11bd-4038-441c-8501-217950de5b6f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:53.545796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=4 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:53.558162 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-45f038f1-42fd-44a1-8845-58d7ebe0711d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:53.567132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-45f038f1-42fd-44a1-8845-58d7ebe0711d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:53.568993 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-45f038f1-42fd-44a1-8845-58d7ebe0711d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:53.570430 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-45f038f1-42fd-44a1-8845-58d7ebe0711d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1739 microversion: 2.20 time: 0.197432 Jun 07 13:22:53.571735 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 541/1074] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:53 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:53.596806 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-39aa11bd-4038-441c-8501-217950de5b6f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:53.606823 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-39aa11bd-4038-441c-8501-217950de5b6f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1265 microversion: 2.1 time: 0.206851 Jun 07 13:22:53.608149 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 534/1075] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:53 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:54.590220 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-72877618-a848-461e-9ee5-fa54310c9189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:54.590865 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-72877618-a848-461e-9ee5-fa54310c9189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:54.604669 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-72877618-a848-461e-9ee5-fa54310c9189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:54.607927 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-72877618-a848-461e-9ee5-fa54310c9189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:54.619163 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-72877618-a848-461e-9ee5-fa54310c9189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:54.620227 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-72877618-a848-461e-9ee5-fa54310c9189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:54.624760 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-df8316b4-64fe-4261-8bdb-b8475e15e23c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:54.626577 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-df8316b4-64fe-4261-8bdb-b8475e15e23c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:54.633901 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-df8316b4-64fe-4261-8bdb-b8475e15e23c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:54.635928 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-df8316b4-64fe-4261-8bdb-b8475e15e23c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:54.636966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-df8316b4-64fe-4261-8bdb-b8475e15e23c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:54.637570 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-df8316b4-64fe-4261-8bdb-b8475e15e23c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:54.845226 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-df8316b4-64fe-4261-8bdb-b8475e15e23c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:54.858019 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-df8316b4-64fe-4261-8bdb-b8475e15e23c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1265 microversion: 2.1 time: 0.237071 Jun 07 13:22:54.869558 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 535/1076] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:54 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:22:54.970863 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-72877618-a848-461e-9ee5-fa54310c9189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:54.970863 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-72877618-a848-461e-9ee5-fa54310c9189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:54.971701 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-72877618-a848-461e-9ee5-fa54310c9189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:54.971701 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-72877618-a848-461e-9ee5-fa54310c9189 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1739 microversion: 2.20 time: 0.368608 Jun 07 13:22:54.971701 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 542/1077] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:54 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1739 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:55.875646 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ad327a88-1884-4ab0-a1f3-aa75eb73b05c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:55.876245 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ad327a88-1884-4ab0-a1f3-aa75eb73b05c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:55.883905 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ad327a88-1884-4ab0-a1f3-aa75eb73b05c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:55.884432 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ad327a88-1884-4ab0-a1f3-aa75eb73b05c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:55.885387 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ad327a88-1884-4ab0-a1f3-aa75eb73b05c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:55.886481 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ad327a88-1884-4ab0-a1f3-aa75eb73b05c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:55.980891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-10082a3f-3ddc-4c37-aad6-fe24decfc970 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:55.981542 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-10082a3f-3ddc-4c37-aad6-fe24decfc970 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:55.990769 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-10082a3f-3ddc-4c37-aad6-fe24decfc970 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:55.991583 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-10082a3f-3ddc-4c37-aad6-fe24decfc970 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:55.992476 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-10082a3f-3ddc-4c37-aad6-fe24decfc970 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:55.992816 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-10082a3f-3ddc-4c37-aad6-fe24decfc970 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:56.042545 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ad327a88-1884-4ab0-a1f3-aa75eb73b05c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:56.052482 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ad327a88-1884-4ab0-a1f3-aa75eb73b05c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1265 microversion: 2.1 time: 0.180643 Jun 07 13:22:56.053177 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 536/1078] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:55 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:56.149775 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-10082a3f-3ddc-4c37-aad6-fe24decfc970 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:56.158953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-10082a3f-3ddc-4c37-aad6-fe24decfc970 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:56.160596 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-10082a3f-3ddc-4c37-aad6-fe24decfc970 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:56.161856 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-10082a3f-3ddc-4c37-aad6-fe24decfc970 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1739 microversion: 2.20 time: 0.189279 Jun 07 13:22:56.164265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 543/1079] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:55 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:57.071291 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7ca8fc2a-bde1-458e-b7b7-ab45bf1c7050 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:57.071821 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7ca8fc2a-bde1-458e-b7b7-ab45bf1c7050 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:57.083909 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7ca8fc2a-bde1-458e-b7b7-ab45bf1c7050 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:57.084857 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7ca8fc2a-bde1-458e-b7b7-ab45bf1c7050 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:57.085895 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7ca8fc2a-bde1-458e-b7b7-ab45bf1c7050 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:57.086896 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7ca8fc2a-bde1-458e-b7b7-ab45bf1c7050 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:57.180888 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4e1ba3c0-ec85-465b-8469-ab133690b8b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:57.181485 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4e1ba3c0-ec85-465b-8469-ab133690b8b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:57.196328 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4e1ba3c0-ec85-465b-8469-ab133690b8b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:57.196786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4e1ba3c0-ec85-465b-8469-ab133690b8b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:57.197595 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4e1ba3c0-ec85-465b-8469-ab133690b8b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:57.198034 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4e1ba3c0-ec85-465b-8469-ab133690b8b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:57.262563 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-7ca8fc2a-bde1-458e-b7b7-ab45bf1c7050 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:57.272674 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-7ca8fc2a-bde1-458e-b7b7-ab45bf1c7050 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1265 microversion: 2.1 time: 0.206489 Jun 07 13:22:57.282281 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 537/1080] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:57 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:57.354040 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4e1ba3c0-ec85-465b-8469-ab133690b8b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:57.365078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4e1ba3c0-ec85-465b-8469-ab133690b8b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:57.366617 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4e1ba3c0-ec85-465b-8469-ab133690b8b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:57.367794 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4e1ba3c0-ec85-465b-8469-ab133690b8b0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1739 microversion: 2.20 time: 0.191259 Jun 07 13:22:57.368356 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 544/1081] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:57 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:58.289208 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-de74f3b0-de1a-4e4e-8374-ea5eec18e6f2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:58.289821 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-de74f3b0-de1a-4e4e-8374-ea5eec18e6f2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:58.296898 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-de74f3b0-de1a-4e4e-8374-ea5eec18e6f2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:58.297619 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-de74f3b0-de1a-4e4e-8374-ea5eec18e6f2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:58.298393 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-de74f3b0-de1a-4e4e-8374-ea5eec18e6f2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:58.298867 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-de74f3b0-de1a-4e4e-8374-ea5eec18e6f2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:58.385821 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c3990d12-1c93-4103-8dde-3126c3cae048 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:58.387779 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c3990d12-1c93-4103-8dde-3126c3cae048 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:58.395241 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3990d12-1c93-4103-8dde-3126c3cae048 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:58.395775 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3990d12-1c93-4103-8dde-3126c3cae048 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:58.396791 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3990d12-1c93-4103-8dde-3126c3cae048 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:58.397302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3990d12-1c93-4103-8dde-3126c3cae048 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:58.481887 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-de74f3b0-de1a-4e4e-8374-ea5eec18e6f2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:58.491831 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-de74f3b0-de1a-4e4e-8374-ea5eec18e6f2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1265 microversion: 2.1 time: 0.206481 Jun 07 13:22:58.493069 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 538/1082] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:58 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:58.538959 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c3990d12-1c93-4103-8dde-3126c3cae048 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:58.547682 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c3990d12-1c93-4103-8dde-3126c3cae048 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:58.549370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c3990d12-1c93-4103-8dde-3126c3cae048 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:58.550678 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c3990d12-1c93-4103-8dde-3126c3cae048 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1739 microversion: 2.20 time: 0.168800 Jun 07 13:22:58.551340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 545/1083] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:58 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:22:59.509402 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5c222c3e-c891-4c8e-a033-ee95d1aafec3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:59.510108 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5c222c3e-c891-4c8e-a033-ee95d1aafec3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:59.516851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5c222c3e-c891-4c8e-a033-ee95d1aafec3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:59.517579 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5c222c3e-c891-4c8e-a033-ee95d1aafec3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:59.518687 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5c222c3e-c891-4c8e-a033-ee95d1aafec3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:59.519365 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5c222c3e-c891-4c8e-a033-ee95d1aafec3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:59.569880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a0ef9df6-4ce7-4320-8140-d88766656895 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:59.571507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a0ef9df6-4ce7-4320-8140-d88766656895 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:59.584385 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a0ef9df6-4ce7-4320-8140-d88766656895 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:59.599060 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a0ef9df6-4ce7-4320-8140-d88766656895 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:59.599915 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a0ef9df6-4ce7-4320-8140-d88766656895 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:59.600367 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a0ef9df6-4ce7-4320-8140-d88766656895 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:59.712446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5c222c3e-c891-4c8e-a033-ee95d1aafec3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:59.721576 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5c222c3e-c891-4c8e-a033-ee95d1aafec3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1265 microversion: 2.1 time: 0.215550 Jun 07 13:22:59.723155 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 539/1084] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:59 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:59.814294 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a0ef9df6-4ce7-4320-8140-d88766656895 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:59.844052 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a0ef9df6-4ce7-4320-8140-d88766656895 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:59.847318 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a0ef9df6-4ce7-4320-8140-d88766656895 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:59.848697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a0ef9df6-4ce7-4320-8140-d88766656895 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1739 microversion: 2.20 time: 0.282802 Jun 07 13:22:59.849733 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 546/1085] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:59 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:00.740646 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-aec92c30-e664-4fab-8870-849644fe030d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:00.741520 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-aec92c30-e664-4fab-8870-849644fe030d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:00.750724 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-aec92c30-e664-4fab-8870-849644fe030d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:00.751436 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-aec92c30-e664-4fab-8870-849644fe030d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:00.752801 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-aec92c30-e664-4fab-8870-849644fe030d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:00.753394 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-aec92c30-e664-4fab-8870-849644fe030d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:00.868327 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c35aeba5-6f37-4f9f-a565-3839795e1de4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:00.869172 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c35aeba5-6f37-4f9f-a565-3839795e1de4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:00.877773 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c35aeba5-6f37-4f9f-a565-3839795e1de4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:00.878380 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c35aeba5-6f37-4f9f-a565-3839795e1de4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:00.879327 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c35aeba5-6f37-4f9f-a565-3839795e1de4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:00.879934 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c35aeba5-6f37-4f9f-a565-3839795e1de4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:00.924572 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-aec92c30-e664-4fab-8870-849644fe030d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:00.935985 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-aec92c30-e664-4fab-8870-849644fe030d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1265 microversion: 2.1 time: 0.200027 Jun 07 13:23:00.937809 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 540/1086] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:00 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:01.079141 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c35aeba5-6f37-4f9f-a565-3839795e1de4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:01.091529 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c35aeba5-6f37-4f9f-a565-3839795e1de4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:01.094485 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c35aeba5-6f37-4f9f-a565-3839795e1de4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:01.097192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c35aeba5-6f37-4f9f-a565-3839795e1de4 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1739 microversion: 2.20 time: 0.232593 Jun 07 13:23:01.098504 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 547/1087] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:00 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:23:01.184317 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-b2789e2e-8004-4296-a775-2ee6552fd01b req-c5ba182a-eaec-463a-8514-109112d9df52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f62c387-9b2e-4a04-bcf7-db7d688bd6f2", "name": "network-vif-plugged", "status": "completed", "tag": "93ee244b-dc39-4f08-b0be-acd8a2ab021d"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:01.193159 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-b2789e2e-8004-4296-a775-2ee6552fd01b req-c5ba182a-eaec-463a-8514-109112d9df52 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:01.194182 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-b2789e2e-8004-4296-a775-2ee6552fd01b req-c5ba182a-eaec-463a-8514-109112d9df52 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:01.212263 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-b2789e2e-8004-4296-a775-2ee6552fd01b req-c5ba182a-eaec-463a-8514-109112d9df52 service nova] Creating event network-vif-plugged:93ee244b-dc39-4f08-b0be-acd8a2ab021d for instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 on hv-cinder-84496 Jun 07 13:23:01.217938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-b2789e2e-8004-4296-a775-2ee6552fd01b req-c5ba182a-eaec-463a-8514-109112d9df52 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037276 Jun 07 13:23:01.219131 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 541/1088] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:01.959811 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1807fef4-fa20-480e-8810-e0c0e385cf45 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:01.961130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1807fef4-fa20-480e-8810-e0c0e385cf45 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:01.968702 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1807fef4-fa20-480e-8810-e0c0e385cf45 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:01.969163 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1807fef4-fa20-480e-8810-e0c0e385cf45 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:01.970129 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1807fef4-fa20-480e-8810-e0c0e385cf45 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:01.970693 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1807fef4-fa20-480e-8810-e0c0e385cf45 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:02.117762 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d2e1a21d-5932-49dc-bb1b-ba5dc2d134fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:02.118393 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d2e1a21d-5932-49dc-bb1b-ba5dc2d134fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:02.132416 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d2e1a21d-5932-49dc-bb1b-ba5dc2d134fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:02.133011 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d2e1a21d-5932-49dc-bb1b-ba5dc2d134fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:02.133170 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1807fef4-fa20-480e-8810-e0c0e385cf45 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:02.133828 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d2e1a21d-5932-49dc-bb1b-ba5dc2d134fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:02.134265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d2e1a21d-5932-49dc-bb1b-ba5dc2d134fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:02.143744 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1807fef4-fa20-480e-8810-e0c0e385cf45 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1265 microversion: 2.1 time: 0.188605 Jun 07 13:23:02.154918 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 548/1089] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:01 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:02.290987 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d2e1a21d-5932-49dc-bb1b-ba5dc2d134fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:02.298988 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d2e1a21d-5932-49dc-bb1b-ba5dc2d134fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:02.300491 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-d2e1a21d-5932-49dc-bb1b-ba5dc2d134fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:02.301650 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d2e1a21d-5932-49dc-bb1b-ba5dc2d134fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1739 microversion: 2.20 time: 0.188197 Jun 07 13:23:02.302212 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 542/1090] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:02 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:23:03.162725 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d5063e0a-9a06-43b9-972a-9c142528950e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:03.163346 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d5063e0a-9a06-43b9-972a-9c142528950e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:03.169742 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d5063e0a-9a06-43b9-972a-9c142528950e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:03.170197 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d5063e0a-9a06-43b9-972a-9c142528950e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:03.170988 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d5063e0a-9a06-43b9-972a-9c142528950e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:03.171430 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d5063e0a-9a06-43b9-972a-9c142528950e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:03.301499 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d5063e0a-9a06-43b9-972a-9c142528950e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:03.309135 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d5063e0a-9a06-43b9-972a-9c142528950e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1265 microversion: 2.1 time: 0.150873 Jun 07 13:23:03.309710 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 549/1091] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:03 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:03.318992 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-dadd369b-71e7-4c3e-b61d-517fdbb63d6d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:03.319627 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-dadd369b-71e7-4c3e-b61d-517fdbb63d6d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:03.325986 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dadd369b-71e7-4c3e-b61d-517fdbb63d6d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:03.326431 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dadd369b-71e7-4c3e-b61d-517fdbb63d6d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:03.327223 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dadd369b-71e7-4c3e-b61d-517fdbb63d6d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:03.327657 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-dadd369b-71e7-4c3e-b61d-517fdbb63d6d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:03.456946 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-dadd369b-71e7-4c3e-b61d-517fdbb63d6d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:03.464776 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-dadd369b-71e7-4c3e-b61d-517fdbb63d6d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:03.466292 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-dadd369b-71e7-4c3e-b61d-517fdbb63d6d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:03.467486 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-dadd369b-71e7-4c3e-b61d-517fdbb63d6d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1739 microversion: 2.20 time: 0.152310 Jun 07 13:23:03.468033 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 543/1092] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:03 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:04.325099 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7aa4782a-0c78-4ce1-befd-9e3d3d8169d6 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:04.325705 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7aa4782a-0c78-4ce1-befd-9e3d3d8169d6 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:04.332212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7aa4782a-0c78-4ce1-befd-9e3d3d8169d6 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:04.332664 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7aa4782a-0c78-4ce1-befd-9e3d3d8169d6 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:04.333418 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7aa4782a-0c78-4ce1-befd-9e3d3d8169d6 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:04.333850 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7aa4782a-0c78-4ce1-befd-9e3d3d8169d6 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:04.464462 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7aa4782a-0c78-4ce1-befd-9e3d3d8169d6 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:04.472523 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7aa4782a-0c78-4ce1-befd-9e3d3d8169d6 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1451 microversion: 2.1 time: 0.151249 Jun 07 13:23:04.473096 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 550/1093] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:04 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:04.487851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b18f0d34-2f71-4cf0-a42b-628342b81858 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:04.488423 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c0b71915-ca69-4173-a094-8cea51156a54 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:04.488558 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b18f0d34-2f71-4cf0-a42b-628342b81858 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:04.489038 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c0b71915-ca69-4173-a094-8cea51156a54 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:04.494910 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c0b71915-ca69-4173-a094-8cea51156a54 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:04.495058 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b18f0d34-2f71-4cf0-a42b-628342b81858 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:04.495364 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c0b71915-ca69-4173-a094-8cea51156a54 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:04.495479 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b18f0d34-2f71-4cf0-a42b-628342b81858 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:04.496138 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c0b71915-ca69-4173-a094-8cea51156a54 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:04.496237 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b18f0d34-2f71-4cf0-a42b-628342b81858 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:04.496580 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c0b71915-ca69-4173-a094-8cea51156a54 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:04.496688 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b18f0d34-2f71-4cf0-a42b-628342b81858 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:04.626133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b18f0d34-2f71-4cf0-a42b-628342b81858 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:04.629289 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c0b71915-ca69-4173-a094-8cea51156a54 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:04.636886 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c0b71915-ca69-4173-a094-8cea51156a54 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1451 microversion: 2.1 time: 0.152665 Jun 07 13:23:04.643129 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 551/1094] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:04 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:04.643319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b18f0d34-2f71-4cf0-a42b-628342b81858 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:04.643319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b18f0d34-2f71-4cf0-a42b-628342b81858 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:04.643319 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b18f0d34-2f71-4cf0-a42b-628342b81858 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1721 microversion: 2.20 time: 0.158479 Jun 07 13:23:04.644158 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 544/1095] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:04 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:05.661467 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-470768d2-4b76-4af7-b072-57ee10748b9f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:05.662192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-470768d2-4b76-4af7-b072-57ee10748b9f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:05.664527 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=68 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:05.669680 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-470768d2-4b76-4af7-b072-57ee10748b9f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:05.670131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-470768d2-4b76-4af7-b072-57ee10748b9f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:05.670920 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-470768d2-4b76-4af7-b072-57ee10748b9f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:05.671358 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-470768d2-4b76-4af7-b072-57ee10748b9f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:05.804888 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-470768d2-4b76-4af7-b072-57ee10748b9f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:05.807168 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:05.814600 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-470768d2-4b76-4af7-b072-57ee10748b9f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:05.816150 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-470768d2-4b76-4af7-b072-57ee10748b9f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:05.817330 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-470768d2-4b76-4af7-b072-57ee10748b9f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1721 microversion: 2.20 time: 0.159876 Jun 07 13:23:05.817977 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 552/1096] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:05 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:06.385888 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-a004d91f-6fa9-474c-a4a6-6c3bb848d8ac req-aaf2610f-eb00-4c17-8fe0-c9866b5f2b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f62c387-9b2e-4a04-bcf7-db7d688bd6f2", "tag": "93ee244b-dc39-4f08-b0be-acd8a2ab021d"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:06.395263 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-a004d91f-6fa9-474c-a4a6-6c3bb848d8ac req-aaf2610f-eb00-4c17-8fe0-c9866b5f2b2e service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:06.395801 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-a004d91f-6fa9-474c-a4a6-6c3bb848d8ac req-aaf2610f-eb00-4c17-8fe0-c9866b5f2b2e service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:06.409530 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-a004d91f-6fa9-474c-a4a6-6c3bb848d8ac req-aaf2610f-eb00-4c17-8fe0-c9866b5f2b2e service nova] Creating event network-changed:93ee244b-dc39-4f08-b0be-acd8a2ab021d for instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 on hv-cinder-84496 Jun 07 13:23:06.414672 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-a004d91f-6fa9-474c-a4a6-6c3bb848d8ac req-aaf2610f-eb00-4c17-8fe0-c9866b5f2b2e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032480 Jun 07 13:23:06.415346 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 545/1097] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:06.835491 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-feefc497-c489-4cac-8cba-a1c63dddac12 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:06.836105 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-feefc497-c489-4cac-8cba-a1c63dddac12 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:06.842331 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-feefc497-c489-4cac-8cba-a1c63dddac12 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:06.842833 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-feefc497-c489-4cac-8cba-a1c63dddac12 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:06.843602 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-feefc497-c489-4cac-8cba-a1c63dddac12 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:06.844040 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-feefc497-c489-4cac-8cba-a1c63dddac12 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:07.048797 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-feefc497-c489-4cac-8cba-a1c63dddac12 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:07.059283 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-feefc497-c489-4cac-8cba-a1c63dddac12 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:07.061175 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-feefc497-c489-4cac-8cba-a1c63dddac12 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:07.063844 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-feefc497-c489-4cac-8cba-a1c63dddac12 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1721 microversion: 2.20 time: 0.231606 Jun 07 13:23:07.064605 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 553/1098] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:06 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:07.108485 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-214151b8-9cd6-49d9-b5ef-12ef32273160 req-50506d62-3f99-4a85-80b6-7939b0711aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7a49f1-361e-4684-9134-0ba52665297b", "name": "network-vif-unplugged", "status": "completed", "tag": "5cbf5f8c-af01-4a2e-8f16-dd54822bb4cd"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:07.118131 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-214151b8-9cd6-49d9-b5ef-12ef32273160 req-50506d62-3f99-4a85-80b6-7939b0711aa3 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:07.118633 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-214151b8-9cd6-49d9-b5ef-12ef32273160 req-50506d62-3f99-4a85-80b6-7939b0711aa3 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:07.130373 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-214151b8-9cd6-49d9-b5ef-12ef32273160 req-50506d62-3f99-4a85-80b6-7939b0711aa3 service nova] Creating event network-vif-unplugged:5cbf5f8c-af01-4a2e-8f16-dd54822bb4cd for instance af7a49f1-361e-4684-9134-0ba52665297b on hv-cinder-84496 Jun 07 13:23:07.135302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-214151b8-9cd6-49d9-b5ef-12ef32273160 req-50506d62-3f99-4a85-80b6-7939b0711aa3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032374 Jun 07 13:23:07.135899 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 546/1099] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:08.081958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1f6abe0b-422b-47e0-b096-b307cc6515ae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:08.082594 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1f6abe0b-422b-47e0-b096-b307cc6515ae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:08.089069 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f6abe0b-422b-47e0-b096-b307cc6515ae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:08.089456 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f6abe0b-422b-47e0-b096-b307cc6515ae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:08.090219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f6abe0b-422b-47e0-b096-b307cc6515ae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:08.090685 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f6abe0b-422b-47e0-b096-b307cc6515ae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:08.219736 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1f6abe0b-422b-47e0-b096-b307cc6515ae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:08.228127 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1f6abe0b-422b-47e0-b096-b307cc6515ae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:08.229656 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1f6abe0b-422b-47e0-b096-b307cc6515ae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:08.230829 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1f6abe0b-422b-47e0-b096-b307cc6515ae tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1664 microversion: 2.20 time: 0.152791 Jun 07 13:23:08.231385 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 554/1100] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:08 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:08.249739 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-bc11ee49-a8b9-4db4-aef7-125c8121e2ba tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d9d142d-277b-445a-bae5-fa956f923666"}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:08.250927 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-bc11ee49-a8b9-4db4-aef7-125c8121e2ba tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:08.257007 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bc11ee49-a8b9-4db4-aef7-125c8121e2ba tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:08.257455 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bc11ee49-a8b9-4db4-aef7-125c8121e2ba tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:08.258210 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bc11ee49-a8b9-4db4-aef7-125c8121e2ba tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:08.258672 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bc11ee49-a8b9-4db4-aef7-125c8121e2ba tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:08.272036 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:08.512912 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-bc11ee49-a8b9-4db4-aef7-125c8121e2ba tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "POST /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.267874 Jun 07 13:23:08.513518 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 547/1101] 10.222.0.58 () {62 vars in 1363 bytes} [Tue Jun 7 13:23:08 2022] POST /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b/os-volume_attachments => generated 188 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:23:08.624921 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fc756c57-1a19-4fe8-84a4-048991c66b48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:08.625412 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fc756c57-1a19-4fe8-84a4-048991c66b48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:08.631258 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fc756c57-1a19-4fe8-84a4-048991c66b48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:08.631701 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fc756c57-1a19-4fe8-84a4-048991c66b48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:08.632451 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fc756c57-1a19-4fe8-84a4-048991c66b48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:08.632877 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fc756c57-1a19-4fe8-84a4-048991c66b48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:08.885958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fc756c57-1a19-4fe8-84a4-048991c66b48 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b/os-volume_attachments/3d9d142d-277b-445a-bae5-fa956f923666" status: 202 len: 0 microversion: 2.20 time: 0.264735 Jun 07 13:23:08.886572 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 555/1102] 10.222.0.58 () {60 vars in 1456 bytes} [Tue Jun 7 13:23:08 2022] DELETE /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b/os-volume_attachments/3d9d142d-277b-445a-bae5-fa956f923666 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:23:08.941769 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1c8627b7-7d92-4ffa-8012-6668b12b6b4e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:08.942324 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1c8627b7-7d92-4ffa-8012-6668b12b6b4e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:08.948361 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1c8627b7-7d92-4ffa-8012-6668b12b6b4e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:08.948803 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1c8627b7-7d92-4ffa-8012-6668b12b6b4e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:08.949550 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1c8627b7-7d92-4ffa-8012-6668b12b6b4e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:08.949981 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1c8627b7-7d92-4ffa-8012-6668b12b6b4e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:09.026484 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1c8627b7-7d92-4ffa-8012-6668b12b6b4e tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "POST /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b/action" status: 202 len: 0 microversion: 2.20 time: 0.089050 Jun 07 13:23:09.027144 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 548/1103] 10.222.0.58 () {62 vars in 1318 bytes} [Tue Jun 7 13:23:08 2022] POST /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:23:09.037579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1bdb3434-792c-4b2f-892d-b1f3b32beff9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:09.038203 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1bdb3434-792c-4b2f-892d-b1f3b32beff9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:09.044933 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1bdb3434-792c-4b2f-892d-b1f3b32beff9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:09.045415 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1bdb3434-792c-4b2f-892d-b1f3b32beff9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:09.046304 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1bdb3434-792c-4b2f-892d-b1f3b32beff9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:09.046830 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1bdb3434-792c-4b2f-892d-b1f3b32beff9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:09.184342 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1bdb3434-792c-4b2f-892d-b1f3b32beff9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:09.194256 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1bdb3434-792c-4b2f-892d-b1f3b32beff9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:09.195850 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1bdb3434-792c-4b2f-892d-b1f3b32beff9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:09.199350 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1bdb3434-792c-4b2f-892d-b1f3b32beff9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1672 microversion: 2.20 time: 0.167947 Jun 07 13:23:09.199933 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 556/1104] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:09 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:23:10.218558 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1113b1f2-dbd7-40a6-9776-fb9fc9d3588c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:10.219175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1113b1f2-dbd7-40a6-9776-fb9fc9d3588c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:10.225624 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1113b1f2-dbd7-40a6-9776-fb9fc9d3588c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:10.226075 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1113b1f2-dbd7-40a6-9776-fb9fc9d3588c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:10.226867 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1113b1f2-dbd7-40a6-9776-fb9fc9d3588c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:10.227302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1113b1f2-dbd7-40a6-9776-fb9fc9d3588c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:10.359038 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1113b1f2-dbd7-40a6-9776-fb9fc9d3588c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:10.367681 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1113b1f2-dbd7-40a6-9776-fb9fc9d3588c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:10.369184 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1113b1f2-dbd7-40a6-9776-fb9fc9d3588c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:10.370398 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1113b1f2-dbd7-40a6-9776-fb9fc9d3588c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.156208 Jun 07 13:23:10.370936 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 549/1105] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:10 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:11.388796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b897b64f-67cf-41eb-b5cc-95aeff65a5a5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:11.389593 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b897b64f-67cf-41eb-b5cc-95aeff65a5a5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:11.396911 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b897b64f-67cf-41eb-b5cc-95aeff65a5a5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:11.397360 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b897b64f-67cf-41eb-b5cc-95aeff65a5a5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:11.398129 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b897b64f-67cf-41eb-b5cc-95aeff65a5a5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:11.398599 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b897b64f-67cf-41eb-b5cc-95aeff65a5a5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:11.565850 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b897b64f-67cf-41eb-b5cc-95aeff65a5a5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:11.573904 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b897b64f-67cf-41eb-b5cc-95aeff65a5a5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:11.575449 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b897b64f-67cf-41eb-b5cc-95aeff65a5a5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:11.576604 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b897b64f-67cf-41eb-b5cc-95aeff65a5a5 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.191880 Jun 07 13:23:11.577164 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 557/1106] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:11 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:12.595369 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-750a2f71-c996-4bf8-bd3b-15995d046aea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:12.596548 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-750a2f71-c996-4bf8-bd3b-15995d046aea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:12.603426 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-750a2f71-c996-4bf8-bd3b-15995d046aea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:12.603807 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-750a2f71-c996-4bf8-bd3b-15995d046aea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:12.604586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-750a2f71-c996-4bf8-bd3b-15995d046aea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:12.605022 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-750a2f71-c996-4bf8-bd3b-15995d046aea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:12.742424 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-750a2f71-c996-4bf8-bd3b-15995d046aea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:12.750828 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-750a2f71-c996-4bf8-bd3b-15995d046aea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:12.753010 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-750a2f71-c996-4bf8-bd3b-15995d046aea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:12.754193 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-750a2f71-c996-4bf8-bd3b-15995d046aea tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.163039 Jun 07 13:23:12.754786 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 550/1107] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:12 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:13.773345 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-677ce630-ddf3-4a57-86d8-0ad839ca21fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:13.773896 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-677ce630-ddf3-4a57-86d8-0ad839ca21fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:13.780176 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-677ce630-ddf3-4a57-86d8-0ad839ca21fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:13.780733 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-677ce630-ddf3-4a57-86d8-0ad839ca21fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:13.781562 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-677ce630-ddf3-4a57-86d8-0ad839ca21fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:13.782100 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-677ce630-ddf3-4a57-86d8-0ad839ca21fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:13.961610 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-677ce630-ddf3-4a57-86d8-0ad839ca21fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:13.970043 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-677ce630-ddf3-4a57-86d8-0ad839ca21fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:13.972207 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-677ce630-ddf3-4a57-86d8-0ad839ca21fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:13.973349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-677ce630-ddf3-4a57-86d8-0ad839ca21fd tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.204178 Jun 07 13:23:13.973913 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 558/1108] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:13 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:23:14.993672 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-999fae0d-28cf-4d0c-b104-9a2803ce5a32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:14.994309 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-999fae0d-28cf-4d0c-b104-9a2803ce5a32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:14.995927 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a215f336-adb4-4358-8259-a42448fb24b7 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdd32670-b2d1-4b41-8d4d-60b424ea6709", "device": "/dev/sdb"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:14.996744 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:14.997646 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a215f336-adb4-4358-8259-a42448fb24b7 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:15.002660 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-999fae0d-28cf-4d0c-b104-9a2803ce5a32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:15.003388 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-999fae0d-28cf-4d0c-b104-9a2803ce5a32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:15.004178 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-999fae0d-28cf-4d0c-b104-9a2803ce5a32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:15.004554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a215f336-adb4-4358-8259-a42448fb24b7 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:15.004665 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-999fae0d-28cf-4d0c-b104-9a2803ce5a32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:15.005005 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a215f336-adb4-4358-8259-a42448fb24b7 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:15.011763 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a215f336-adb4-4358-8259-a42448fb24b7 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:15.012259 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a215f336-adb4-4358-8259-a42448fb24b7 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:15.150218 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-999fae0d-28cf-4d0c-b104-9a2803ce5a32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:15.162940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-999fae0d-28cf-4d0c-b104-9a2803ce5a32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:15.164450 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-999fae0d-28cf-4d0c-b104-9a2803ce5a32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:15.165652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-999fae0d-28cf-4d0c-b104-9a2803ce5a32 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.176318 Jun 07 13:23:15.166600 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 551/1109] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:14 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:16.184961 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-fd88957d-3cfb-4cff-9205-38b5df9ddd7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:16.185596 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-fd88957d-3cfb-4cff-9205-38b5df9ddd7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:16.192084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fd88957d-3cfb-4cff-9205-38b5df9ddd7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:16.192536 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fd88957d-3cfb-4cff-9205-38b5df9ddd7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:16.193303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fd88957d-3cfb-4cff-9205-38b5df9ddd7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:16.193741 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fd88957d-3cfb-4cff-9205-38b5df9ddd7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:16.340584 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-fd88957d-3cfb-4cff-9205-38b5df9ddd7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:16.348501 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-fd88957d-3cfb-4cff-9205-38b5df9ddd7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:16.350139 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-fd88957d-3cfb-4cff-9205-38b5df9ddd7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:16.351325 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-fd88957d-3cfb-4cff-9205-38b5df9ddd7d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.170444 Jun 07 13:23:16.351881 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 552/1110] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:16 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:23:17.369263 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a1ed39ba-b846-4385-a7a5-48ffd8cfe9d6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:17.369922 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a1ed39ba-b846-4385-a7a5-48ffd8cfe9d6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:17.376519 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a1ed39ba-b846-4385-a7a5-48ffd8cfe9d6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:17.376967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a1ed39ba-b846-4385-a7a5-48ffd8cfe9d6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:17.377722 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a1ed39ba-b846-4385-a7a5-48ffd8cfe9d6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:17.378158 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a1ed39ba-b846-4385-a7a5-48ffd8cfe9d6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:17.509510 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a1ed39ba-b846-4385-a7a5-48ffd8cfe9d6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:17.517891 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a1ed39ba-b846-4385-a7a5-48ffd8cfe9d6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:17.519418 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a1ed39ba-b846-4385-a7a5-48ffd8cfe9d6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:17.520573 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a1ed39ba-b846-4385-a7a5-48ffd8cfe9d6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.155364 Jun 07 13:23:17.521127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 553/1111] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:17 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:23:18.538987 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0dfdf29f-627b-43d3-b405-fee17f401c65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:18.539735 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0dfdf29f-627b-43d3-b405-fee17f401c65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:18.546157 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0dfdf29f-627b-43d3-b405-fee17f401c65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:18.546645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0dfdf29f-627b-43d3-b405-fee17f401c65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:18.547419 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0dfdf29f-627b-43d3-b405-fee17f401c65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:18.547859 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0dfdf29f-627b-43d3-b405-fee17f401c65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:18.688352 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0dfdf29f-627b-43d3-b405-fee17f401c65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:18.698729 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0dfdf29f-627b-43d3-b405-fee17f401c65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:18.701345 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0dfdf29f-627b-43d3-b405-fee17f401c65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:18.703290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0dfdf29f-627b-43d3-b405-fee17f401c65 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.168070 Jun 07 13:23:18.714747 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 554/1112] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:18 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:23:19.722246 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-8a084e6d-d2ad-4bab-9117-0dfd3966a517 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:19.722913 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-8a084e6d-d2ad-4bab-9117-0dfd3966a517 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:19.729278 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8a084e6d-d2ad-4bab-9117-0dfd3966a517 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:19.729723 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8a084e6d-d2ad-4bab-9117-0dfd3966a517 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:19.730515 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8a084e6d-d2ad-4bab-9117-0dfd3966a517 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:19.730953 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-8a084e6d-d2ad-4bab-9117-0dfd3966a517 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:19.865764 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8a084e6d-d2ad-4bab-9117-0dfd3966a517 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:19.874059 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8a084e6d-d2ad-4bab-9117-0dfd3966a517 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:19.875597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-8a084e6d-d2ad-4bab-9117-0dfd3966a517 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:19.877353 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-8a084e6d-d2ad-4bab-9117-0dfd3966a517 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.158489 Jun 07 13:23:19.878099 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 555/1113] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:19 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:23:20.592249 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1871bd3e-cdad-4127-a868-361f7fbd9f00 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:20.592744 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1871bd3e-cdad-4127-a868-361f7fbd9f00 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:20.599249 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1871bd3e-cdad-4127-a868-361f7fbd9f00 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:20.599698 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1871bd3e-cdad-4127-a868-361f7fbd9f00 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:20.600448 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1871bd3e-cdad-4127-a868-361f7fbd9f00 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:20.600890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1871bd3e-cdad-4127-a868-361f7fbd9f00 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:20.624386 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1871bd3e-cdad-4127-a868-361f7fbd9f00 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/ips" status: 200 len: 146 microversion: 2.1 time: 0.035952 Jun 07 13:23:20.624944 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 556/1114] 10.222.0.58 () {58 vars in 1247 bytes} [Tue Jun 7 13:23:20 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:23:20.896327 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a07f86f3-351a-4235-9cf6-572f2af74db1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:20.897712 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a07f86f3-351a-4235-9cf6-572f2af74db1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:20.905999 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a07f86f3-351a-4235-9cf6-572f2af74db1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:20.906850 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a07f86f3-351a-4235-9cf6-572f2af74db1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:20.907983 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a07f86f3-351a-4235-9cf6-572f2af74db1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:20.908657 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a07f86f3-351a-4235-9cf6-572f2af74db1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:21.056922 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a07f86f3-351a-4235-9cf6-572f2af74db1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:21.065836 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a07f86f3-351a-4235-9cf6-572f2af74db1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:21.067375 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a07f86f3-351a-4235-9cf6-572f2af74db1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:21.068885 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a07f86f3-351a-4235-9cf6-572f2af74db1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.177220 Jun 07 13:23:21.069997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 557/1115] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:20 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:23:22.091293 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-2da6b80a-2d9f-4d61-9ced-b0eced7ee4ca tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:22.092034 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-2da6b80a-2d9f-4d61-9ced-b0eced7ee4ca tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:22.103079 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2da6b80a-2d9f-4d61-9ced-b0eced7ee4ca tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:22.103546 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2da6b80a-2d9f-4d61-9ced-b0eced7ee4ca tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:22.104332 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2da6b80a-2d9f-4d61-9ced-b0eced7ee4ca tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:22.104776 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2da6b80a-2d9f-4d61-9ced-b0eced7ee4ca tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:22.238566 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-2da6b80a-2d9f-4d61-9ced-b0eced7ee4ca tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:22.246421 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-2da6b80a-2d9f-4d61-9ced-b0eced7ee4ca tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:22.247959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-2da6b80a-2d9f-4d61-9ced-b0eced7ee4ca tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:22.249109 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-2da6b80a-2d9f-4d61-9ced-b0eced7ee4ca tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.162020 Jun 07 13:23:22.249669 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 558/1116] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:22 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:23:22.999293 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-6e2d5afa-1ff6-455e-8500-2b49f93eb653 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea119f97-276e-407f-b177-6364e5f720bf"}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:23.000420 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-6e2d5afa-1ff6-455e-8500-2b49f93eb653 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:23.007227 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6e2d5afa-1ff6-455e-8500-2b49f93eb653 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:23.007674 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6e2d5afa-1ff6-455e-8500-2b49f93eb653 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:23.008425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6e2d5afa-1ff6-455e-8500-2b49f93eb653 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:23.008855 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6e2d5afa-1ff6-455e-8500-2b49f93eb653 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:25.004289 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=15 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:25.106808 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:27.487887 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:27.499340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a215f336-adb4-4358-8259-a42448fb24b7 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "POST /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.507312 Jun 07 13:23:27.500307 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 559/1117] 10.222.0.58 () {60 vars in 1322 bytes} [Tue Jun 7 13:23:14 2022] POST /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9/os-volume_attachments => generated 194 bytes in 12509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:23:27.505769 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-38ae975f-7114-4b8b-a121-17cf154bf667 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:27.506554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-38ae975f-7114-4b8b-a121-17cf154bf667 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:27.513055 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38ae975f-7114-4b8b-a121-17cf154bf667 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:27.513538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38ae975f-7114-4b8b-a121-17cf154bf667 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:27.514371 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38ae975f-7114-4b8b-a121-17cf154bf667 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:27.514865 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38ae975f-7114-4b8b-a121-17cf154bf667 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:27.522509 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-6e2d5afa-1ff6-455e-8500-2b49f93eb653 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "POST /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.526943 Jun 07 13:23:27.527840 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 559/1118] 10.222.0.58 () {60 vars in 1322 bytes} [Tue Jun 7 13:23:22 2022] POST /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments => generated 194 bytes in 4529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:23:27.645135 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-38ae975f-7114-4b8b-a121-17cf154bf667 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:27.653232 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-38ae975f-7114-4b8b-a121-17cf154bf667 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:27.654779 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-38ae975f-7114-4b8b-a121-17cf154bf667 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:27.655933 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-38ae975f-7114-4b8b-a121-17cf154bf667 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.154565 Jun 07 13:23:27.656485 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 560/1119] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:27 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:28.673625 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0563b0db-af0e-40f1-9472-205f0e057278 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:28.674854 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0563b0db-af0e-40f1-9472-205f0e057278 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:28.682137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0563b0db-af0e-40f1-9472-205f0e057278 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:28.682712 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0563b0db-af0e-40f1-9472-205f0e057278 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:28.683557 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0563b0db-af0e-40f1-9472-205f0e057278 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:28.684130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0563b0db-af0e-40f1-9472-205f0e057278 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:28.814562 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0563b0db-af0e-40f1-9472-205f0e057278 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:28.823088 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0563b0db-af0e-40f1-9472-205f0e057278 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:28.824616 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-0563b0db-af0e-40f1-9472-205f0e057278 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:28.825779 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0563b0db-af0e-40f1-9472-205f0e057278 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.156580 Jun 07 13:23:28.826342 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 560/1120] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:28 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:29.843711 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c211b023-e8f3-41cf-a9d3-55469c2bd332 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:29.844327 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c211b023-e8f3-41cf-a9d3-55469c2bd332 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:29.850758 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c211b023-e8f3-41cf-a9d3-55469c2bd332 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.851214 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c211b023-e8f3-41cf-a9d3-55469c2bd332 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:29.851979 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c211b023-e8f3-41cf-a9d3-55469c2bd332 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.852416 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c211b023-e8f3-41cf-a9d3-55469c2bd332 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:29.981547 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c211b023-e8f3-41cf-a9d3-55469c2bd332 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:29.989370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c211b023-e8f3-41cf-a9d3-55469c2bd332 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:29.991065 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c211b023-e8f3-41cf-a9d3-55469c2bd332 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:29.992212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c211b023-e8f3-41cf-a9d3-55469c2bd332 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.152429 Jun 07 13:23:29.992777 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 561/1121] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:29 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:31.010530 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-04aaa96e-24af-4191-abfc-addc2efbfaa1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:31.011161 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-04aaa96e-24af-4191-abfc-addc2efbfaa1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:31.017669 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-04aaa96e-24af-4191-abfc-addc2efbfaa1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:31.018643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-04aaa96e-24af-4191-abfc-addc2efbfaa1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:31.019397 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-04aaa96e-24af-4191-abfc-addc2efbfaa1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:31.019840 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-04aaa96e-24af-4191-abfc-addc2efbfaa1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:31.153691 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-04aaa96e-24af-4191-abfc-addc2efbfaa1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:31.163386 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-04aaa96e-24af-4191-abfc-addc2efbfaa1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:31.164883 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-04aaa96e-24af-4191-abfc-addc2efbfaa1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:31.166218 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-04aaa96e-24af-4191-abfc-addc2efbfaa1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.159435 Jun 07 13:23:31.167094 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 561/1122] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:31 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:32.185969 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c8f840ce-6688-44d2-bf6f-1b29276479f1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:32.187040 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c8f840ce-6688-44d2-bf6f-1b29276479f1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:32.193498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c8f840ce-6688-44d2-bf6f-1b29276479f1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:32.193944 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c8f840ce-6688-44d2-bf6f-1b29276479f1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:32.194734 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c8f840ce-6688-44d2-bf6f-1b29276479f1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:32.195173 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c8f840ce-6688-44d2-bf6f-1b29276479f1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:32.321333 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c8f840ce-6688-44d2-bf6f-1b29276479f1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:32.329266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c8f840ce-6688-44d2-bf6f-1b29276479f1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:32.330826 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c8f840ce-6688-44d2-bf6f-1b29276479f1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:32.331974 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c8f840ce-6688-44d2-bf6f-1b29276479f1 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.150048 Jun 07 13:23:32.332532 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 562/1123] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:32 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:33.322886 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-396079d2-0244-4bfc-bfca-a535324a1424 req-86138501-75be-4b2e-9d0f-66af7dd5bb35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7a49f1-361e-4684-9134-0ba52665297b", "name": "network-vif-plugged", "status": "completed", "tag": "5cbf5f8c-af01-4a2e-8f16-dd54822bb4cd"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:33.331472 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-396079d2-0244-4bfc-bfca-a535324a1424 req-86138501-75be-4b2e-9d0f-66af7dd5bb35 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:33.331922 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-396079d2-0244-4bfc-bfca-a535324a1424 req-86138501-75be-4b2e-9d0f-66af7dd5bb35 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:33.343011 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-396079d2-0244-4bfc-bfca-a535324a1424 req-86138501-75be-4b2e-9d0f-66af7dd5bb35 service nova] Creating event network-vif-plugged:5cbf5f8c-af01-4a2e-8f16-dd54822bb4cd for instance af7a49f1-361e-4684-9134-0ba52665297b on hv-cinder-84496 Jun 07 13:23:33.347765 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-396079d2-0244-4bfc-bfca-a535324a1424 req-86138501-75be-4b2e-9d0f-66af7dd5bb35 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028598 Jun 07 13:23:33.348671 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 562/1124] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:33.350316 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2ac3f3cc-92b7-446d-b9f7-14668ccfd95c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:33.351153 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2ac3f3cc-92b7-446d-b9f7-14668ccfd95c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:33.358764 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ac3f3cc-92b7-446d-b9f7-14668ccfd95c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:33.359772 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ac3f3cc-92b7-446d-b9f7-14668ccfd95c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:33.360605 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ac3f3cc-92b7-446d-b9f7-14668ccfd95c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:33.361606 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ac3f3cc-92b7-446d-b9f7-14668ccfd95c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:33.508848 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2ac3f3cc-92b7-446d-b9f7-14668ccfd95c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:33.518545 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2ac3f3cc-92b7-446d-b9f7-14668ccfd95c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:33.520032 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2ac3f3cc-92b7-446d-b9f7-14668ccfd95c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:33.521183 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2ac3f3cc-92b7-446d-b9f7-14668ccfd95c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.175315 Jun 07 13:23:33.521738 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 563/1125] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:33 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:34.540973 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c8ad2ed5-cc12-489f-ae11-73ab58518130 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:34.541557 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c8ad2ed5-cc12-489f-ae11-73ab58518130 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:34.547784 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c8ad2ed5-cc12-489f-ae11-73ab58518130 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:34.548228 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c8ad2ed5-cc12-489f-ae11-73ab58518130 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:34.548976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c8ad2ed5-cc12-489f-ae11-73ab58518130 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:34.549404 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c8ad2ed5-cc12-489f-ae11-73ab58518130 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:34.675012 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c8ad2ed5-cc12-489f-ae11-73ab58518130 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:34.682821 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c8ad2ed5-cc12-489f-ae11-73ab58518130 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:34.684667 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c8ad2ed5-cc12-489f-ae11-73ab58518130 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:34.685943 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c8ad2ed5-cc12-489f-ae11-73ab58518130 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.149786 Jun 07 13:23:34.686527 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 563/1126] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:34 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:35.704180 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b2d11bef-cbb9-4405-8e35-3c9b8ea91f64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:35.704789 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b2d11bef-cbb9-4405-8e35-3c9b8ea91f64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:35.711317 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b2d11bef-cbb9-4405-8e35-3c9b8ea91f64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:35.711770 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b2d11bef-cbb9-4405-8e35-3c9b8ea91f64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:35.712527 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b2d11bef-cbb9-4405-8e35-3c9b8ea91f64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:35.712963 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b2d11bef-cbb9-4405-8e35-3c9b8ea91f64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:35.843485 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b2d11bef-cbb9-4405-8e35-3c9b8ea91f64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:35.851838 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b2d11bef-cbb9-4405-8e35-3c9b8ea91f64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:35.853333 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b2d11bef-cbb9-4405-8e35-3c9b8ea91f64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:35.854509 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b2d11bef-cbb9-4405-8e35-3c9b8ea91f64 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1730 microversion: 2.20 time: 0.154203 Jun 07 13:23:35.855059 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 564/1127] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:35 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:36.873393 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-98036113-90c5-4c99-813d-e0a2445e578b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:36.874002 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-98036113-90c5-4c99-813d-e0a2445e578b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:36.881266 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-98036113-90c5-4c99-813d-e0a2445e578b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:36.881715 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-98036113-90c5-4c99-813d-e0a2445e578b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:36.882502 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-98036113-90c5-4c99-813d-e0a2445e578b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:36.882943 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-98036113-90c5-4c99-813d-e0a2445e578b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:37.016493 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-98036113-90c5-4c99-813d-e0a2445e578b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:37.024586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-98036113-90c5-4c99-813d-e0a2445e578b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:37.026486 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-98036113-90c5-4c99-813d-e0a2445e578b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:37.027718 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-98036113-90c5-4c99-813d-e0a2445e578b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1717 microversion: 2.20 time: 0.158216 Jun 07 13:23:37.028353 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 564/1128] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:36 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1717 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:48.726786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0c2a2777-eece-40a3-b00d-61e58a48580c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:48.727815 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0c2a2777-eece-40a3-b00d-61e58a48580c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:48.730402 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=10 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:48.731126 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:48.737085 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0c2a2777-eece-40a3-b00d-61e58a48580c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:48.738163 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0c2a2777-eece-40a3-b00d-61e58a48580c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:48.738969 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0c2a2777-eece-40a3-b00d-61e58a48580c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:48.739407 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0c2a2777-eece-40a3-b00d-61e58a48580c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:48.770270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0c2a2777-eece-40a3-b00d-61e58a48580c tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048593 Jun 07 13:23:48.770857 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 565/1129] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:23:48 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:48.783918 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b3f4eaf8-7cc9-4c78-a28f-de0d475a8feb tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:48.785168 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b3f4eaf8-7cc9-4c78-a28f-de0d475a8feb tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:48.789864 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=27 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:48.790600 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:48.796916 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b3f4eaf8-7cc9-4c78-a28f-de0d475a8feb tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:48.797362 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b3f4eaf8-7cc9-4c78-a28f-de0d475a8feb tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:48.798249 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b3f4eaf8-7cc9-4c78-a28f-de0d475a8feb tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:48.798711 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b3f4eaf8-7cc9-4c78-a28f-de0d475a8feb tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:48.837636 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b3f4eaf8-7cc9-4c78-a28f-de0d475a8feb tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments/ea119f97-276e-407f-b177-6364e5f720bf" status: 200 len: 194 microversion: 2.1 time: 0.060428 Jun 07 13:23:48.838459 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 565/1130] 10.222.0.58 () {58 vars in 1412 bytes} [Tue Jun 7 13:23:48 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments/ea119f97-276e-407f-b177-6364e5f720bf => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:50.182212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a823d04a-cce0-472a-8e93-0f5584663f28 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8191bc3d-4c66-4fa4-a2c2-0bc15d33e2a0"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:50.183326 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a823d04a-cce0-472a-8e93-0f5584663f28 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:50.190363 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a823d04a-cce0-472a-8e93-0f5584663f28 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:50.190868 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a823d04a-cce0-472a-8e93-0f5584663f28 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:50.191641 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a823d04a-cce0-472a-8e93-0f5584663f28 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:50.192083 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a823d04a-cce0-472a-8e93-0f5584663f28 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:54.212919 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a823d04a-cce0-472a-8e93-0f5584663f28 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "POST /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.034496 Jun 07 13:23:54.213791 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 566/1131] 10.222.0.58 () {60 vars in 1322 bytes} [Tue Jun 7 13:23:50 2022] POST /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments => generated 194 bytes in 4036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:58.447610 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9e896722-92e5-4719-bf8c-4db8e9587a75 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:58.448105 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9e896722-92e5-4719-bf8c-4db8e9587a75 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:58.454477 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e896722-92e5-4719-bf8c-4db8e9587a75 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:58.454931 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e896722-92e5-4719-bf8c-4db8e9587a75 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:58.455689 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e896722-92e5-4719-bf8c-4db8e9587a75 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:58.456120 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9e896722-92e5-4719-bf8c-4db8e9587a75 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:58.583798 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-9e896722-92e5-4719-bf8c-4db8e9587a75 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lazy-loading 'services' on Instance uuid 20142887-e2ee-41f7-ad62-2e938b3c36f9 {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:23:58.653588 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9e896722-92e5-4719-bf8c-4db8e9587a75 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "DELETE /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9/os-volume_attachments/fdd32670-b2d1-4b41-8d4d-60b424ea6709" status: 202 len: 0 microversion: 2.1 time: 0.209690 Jun 07 13:23:58.654210 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 566/1132] 10.222.0.58 () {58 vars in 1415 bytes} [Tue Jun 7 13:23:58 2022] DELETE /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9/os-volume_attachments/fdd32670-b2d1-4b41-8d4d-60b424ea6709 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:24:02.740346 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=4 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:02.744918 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-06bb5743-db88-427a-ac62-0bfdd8985a18 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:02.745979 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-06bb5743-db88-427a-ac62-0bfdd8985a18 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:02.752369 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-06bb5743-db88-427a-ac62-0bfdd8985a18 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:02.752818 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-06bb5743-db88-427a-ac62-0bfdd8985a18 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:02.753572 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-06bb5743-db88-427a-ac62-0bfdd8985a18 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:02.754004 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-06bb5743-db88-427a-ac62-0bfdd8985a18 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:02.782552 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-06bb5743-db88-427a-ac62-0bfdd8985a18 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043715 Jun 07 13:24:02.783102 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 567/1133] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:24:02 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:02.926618 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-43055641-8a02-45c7-b1d2-e4cb414456d4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:02.927202 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-43055641-8a02-45c7-b1d2-e4cb414456d4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:02.933330 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-43055641-8a02-45c7-b1d2-e4cb414456d4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:02.933780 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-43055641-8a02-45c7-b1d2-e4cb414456d4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:02.934599 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-43055641-8a02-45c7-b1d2-e4cb414456d4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:02.935022 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-43055641-8a02-45c7-b1d2-e4cb414456d4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:02.962541 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-43055641-8a02-45c7-b1d2-e4cb414456d4 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments/ea119f97-276e-407f-b177-6364e5f720bf" status: 200 len: 194 microversion: 2.1 time: 0.041539 Jun 07 13:24:02.963308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 567/1134] 10.222.0.58 () {58 vars in 1412 bytes} [Tue Jun 7 13:24:02 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments/ea119f97-276e-407f-b177-6364e5f720bf => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:02.973075 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a2c179f6-db67-4ee4-bf4e-fe6108f365c3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:02.973607 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a2c179f6-db67-4ee4-bf4e-fe6108f365c3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:02.979907 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a2c179f6-db67-4ee4-bf4e-fe6108f365c3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:02.980349 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a2c179f6-db67-4ee4-bf4e-fe6108f365c3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:02.981100 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a2c179f6-db67-4ee4-bf4e-fe6108f365c3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:02.981527 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a2c179f6-db67-4ee4-bf4e-fe6108f365c3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:03.061901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-a2c179f6-db67-4ee4-bf4e-fe6108f365c3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lazy-loading 'services' on Instance uuid e529399b-e8ad-4d23-8b5d-6d6633ebf04c {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:24:03.133099 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a2c179f6-db67-4ee4-bf4e-fe6108f365c3 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments/ea119f97-276e-407f-b177-6364e5f720bf" status: 202 len: 0 microversion: 2.1 time: 0.164259 Jun 07 13:24:03.133685 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 568/1135] 10.222.0.58 () {58 vars in 1415 bytes} [Tue Jun 7 13:24:02 2022] DELETE /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments/ea119f97-276e-407f-b177-6364e5f720bf => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:24:03.983068 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9c988186-81b7-44c2-a90e-dd4b003fd059 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:03.983594 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9c988186-81b7-44c2-a90e-dd4b003fd059 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:03.989931 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9c988186-81b7-44c2-a90e-dd4b003fd059 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:03.990377 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9c988186-81b7-44c2-a90e-dd4b003fd059 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:03.991169 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9c988186-81b7-44c2-a90e-dd4b003fd059 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:03.991608 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9c988186-81b7-44c2-a90e-dd4b003fd059 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:04.017980 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9c988186-81b7-44c2-a90e-dd4b003fd059 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Going to try to terminate instance {{(pid=117797) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:24:04.090228 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9c988186-81b7-44c2-a90e-dd4b003fd059 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "DELETE /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 204 len: 0 microversion: 2.1 time: 0.110657 Jun 07 13:24:04.090756 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 568/1136] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:24:03 2022] DELETE /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:24:04.100788 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7ed78c30-68c6-4c38-bd99-324460cd0cb1 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:04.101496 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7ed78c30-68c6-4c38-bd99-324460cd0cb1 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:04.107914 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7ed78c30-68c6-4c38-bd99-324460cd0cb1 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:04.108373 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7ed78c30-68c6-4c38-bd99-324460cd0cb1 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:04.109225 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7ed78c30-68c6-4c38-bd99-324460cd0cb1 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:04.109682 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7ed78c30-68c6-4c38-bd99-324460cd0cb1 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:04.255090 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7ed78c30-68c6-4c38-bd99-324460cd0cb1 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:04.262608 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7ed78c30-68c6-4c38-bd99-324460cd0cb1 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 200 len: 1513 microversion: 2.1 time: 0.167451 Jun 07 13:24:04.263164 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 569/1137] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:04 2022] GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:05.280792 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f308814f-67c7-48dc-bad1-62ce2db721dc tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:05.281482 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f308814f-67c7-48dc-bad1-62ce2db721dc tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:05.288447 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f308814f-67c7-48dc-bad1-62ce2db721dc tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:05.288889 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f308814f-67c7-48dc-bad1-62ce2db721dc tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:05.289641 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f308814f-67c7-48dc-bad1-62ce2db721dc tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:05.290069 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f308814f-67c7-48dc-bad1-62ce2db721dc tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:05.417067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f308814f-67c7-48dc-bad1-62ce2db721dc tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:05.424483 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f308814f-67c7-48dc-bad1-62ce2db721dc tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 200 len: 1513 microversion: 2.1 time: 0.147862 Jun 07 13:24:05.425295 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 569/1138] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:05 2022] GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:06.360887 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-868043d3-2199-4d3d-95d3-e06643e9515b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:06.361415 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-868043d3-2199-4d3d-95d3-e06643e9515b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:06.368268 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-868043d3-2199-4d3d-95d3-e06643e9515b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:06.368712 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-868043d3-2199-4d3d-95d3-e06643e9515b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:06.369463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-868043d3-2199-4d3d-95d3-e06643e9515b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:06.369894 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-868043d3-2199-4d3d-95d3-e06643e9515b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:06.398656 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-868043d3-2199-4d3d-95d3-e06643e9515b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments/8191bc3d-4c66-4fa4-a2c2-0bc15d33e2a0" status: 200 len: 194 microversion: 2.1 time: 0.041564 Jun 07 13:24:06.399246 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 570/1139] 10.222.0.58 () {58 vars in 1412 bytes} [Tue Jun 7 13:24:06 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments/8191bc3d-4c66-4fa4-a2c2-0bc15d33e2a0 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:06.409767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3ad30993-6b45-4b8a-8574-60c0e09083fd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:06.410354 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3ad30993-6b45-4b8a-8574-60c0e09083fd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:06.416923 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3ad30993-6b45-4b8a-8574-60c0e09083fd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:06.417370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3ad30993-6b45-4b8a-8574-60c0e09083fd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:06.418162 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3ad30993-6b45-4b8a-8574-60c0e09083fd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:06.418665 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3ad30993-6b45-4b8a-8574-60c0e09083fd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:06.442804 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0eedc964-c7ea-40e0-97d7-28e4e60dfebd tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:06.443430 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0eedc964-c7ea-40e0-97d7-28e4e60dfebd tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:06.449468 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0eedc964-c7ea-40e0-97d7-28e4e60dfebd tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:06.449920 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0eedc964-c7ea-40e0-97d7-28e4e60dfebd tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:06.451016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0eedc964-c7ea-40e0-97d7-28e4e60dfebd tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:06.451465 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0eedc964-c7ea-40e0-97d7-28e4e60dfebd tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:06.504069 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-3ad30993-6b45-4b8a-8574-60c0e09083fd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lazy-loading 'services' on Instance uuid e529399b-e8ad-4d23-8b5d-6d6633ebf04c {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:24:06.587243 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3ad30993-6b45-4b8a-8574-60c0e09083fd tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments/8191bc3d-4c66-4fa4-a2c2-0bc15d33e2a0" status: 202 len: 0 microversion: 2.1 time: 0.181165 Jun 07 13:24:06.587861 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 570/1140] 10.222.0.58 () {58 vars in 1415 bytes} [Tue Jun 7 13:24:06 2022] DELETE /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments/8191bc3d-4c66-4fa4-a2c2-0bc15d33e2a0 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 13:24:06.658181 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0eedc964-c7ea-40e0-97d7-28e4e60dfebd tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:06.666427 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0eedc964-c7ea-40e0-97d7-28e4e60dfebd tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 200 len: 1513 microversion: 2.1 time: 0.228015 Jun 07 13:24:06.667019 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 571/1141] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:06 2022] GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:24:06.854136 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-b37ed168-c0c9-459e-a839-7fef4b7e19aa req-9750fecd-65e7-4f18-a0ba-0129799679ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20142887-e2ee-41f7-ad62-2e938b3c36f9", "name": "network-vif-deleted", "tag": "6dfd74be-2c6a-41c1-ae2f-f16d2f21a144"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:06.863132 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-b37ed168-c0c9-459e-a839-7fef4b7e19aa req-9750fecd-65e7-4f18-a0ba-0129799679ad service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:06.863578 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-b37ed168-c0c9-459e-a839-7fef4b7e19aa req-9750fecd-65e7-4f18-a0ba-0129799679ad service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:06.874067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-b37ed168-c0c9-459e-a839-7fef4b7e19aa req-9750fecd-65e7-4f18-a0ba-0129799679ad service nova] Creating event network-vif-deleted:6dfd74be-2c6a-41c1-ae2f-f16d2f21a144 for instance 20142887-e2ee-41f7-ad62-2e938b3c36f9 on hv-cinder-84496 Jun 07 13:24:06.879152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-b37ed168-c0c9-459e-a839-7fef4b7e19aa req-9750fecd-65e7-4f18-a0ba-0129799679ad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029008 Jun 07 13:24:06.879736 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 571/1142] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:07.683462 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a3a94a50-8859-4ff3-8ff2-25f2a99c9c34 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:07.684710 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a3a94a50-8859-4ff3-8ff2-25f2a99c9c34 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: 20142887-e2ee-41f7-ad62-2e938b3c36f9] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:07.693864 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a3a94a50-8859-4ff3-8ff2-25f2a99c9c34 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:07.694447 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a3a94a50-8859-4ff3-8ff2-25f2a99c9c34 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:07.695463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a3a94a50-8859-4ff3-8ff2-25f2a99c9c34 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:07.696029 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a3a94a50-8859-4ff3-8ff2-25f2a99c9c34 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:07.711435 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-a3a94a50-8859-4ff3-8ff2-25f2a99c9c34 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] HTTP exception thrown: Instance 20142887-e2ee-41f7-ad62-2e938b3c36f9 could not be found. Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a3a94a50-8859-4ff3-8ff2-25f2a99c9c34 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Request method failure captured: Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 HTTP/1.1 Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin1EYCnRLk_E3sLDVLgD9ngzxDmGHMEbuEQnmZE2_Z92X714OXpRJravt2fS8bqN-pgONzIF-p3UYYgBeKz7bqQLnTdPoz477WcoASWxLgBYNLsRTnGqpUHeurWnw1oN7_lYRHdUohsDK6iy7drw5yd59OcaE6_zG-rntOtW9340DR-Y Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 14800dce94ee42638e6335472a0a46a7 Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-VolumesSnapshotTestJSON-773471708 Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:24:07.713249 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:24:07.714880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14800dce94ee42638e6335472a0a46a7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14800dce94ee42638e6335472a0a46a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14800dce94ee42638e6335472a0a46a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14800dce94ee42638e6335472a0a46a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:24:07.714880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-VolumesSnapshotTestJSON-773471708 Jun 07 13:24:07.714880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 14800dce94ee42638e6335472a0a46a7 Jun 07 13:24:07.714880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-773471708 Jun 07 13:24:07.714880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-VolumesSnapshotTestJSON-773471708-project Jun 07 13:24:07.714880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:24:07.714880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:24:07.714880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 2520416576534123979c732a6837a368 Jun 07 13:24:07.714880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-VolumesSnapshotTestJSON-773471708-project Jun 07 13:24:07.714880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:24:07.714880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance 20142887-e2ee-41f7-ad62-2e938b3c36f9 could not be found. Jun 07 13:24:07.714880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': '20142887-e2ee-41f7-ad62-2e938b3c36f9'} Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20142887-e2ee-41f7-ad62-2e938b3c36f9 could not be found. Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:24:07.719006 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20142887-e2ee-41f7-ad62-2e938b3c36f9 could not be found. Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20142887-e2ee-41f7-ad62-2e938b3c36f9 could not be found. Jun 07 13:24:07.720538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:07.721927 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a3a94a50-8859-4ff3-8ff2-25f2a99c9c34 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Returning 404 to user: Instance 20142887-e2ee-41f7-ad62-2e938b3c36f9 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:24:07.721927 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a3a94a50-8859-4ff3-8ff2-25f2a99c9c34 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9" status: 404 len: 111 microversion: 2.1 time: 0.035326 Jun 07 13:24:07.721927 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 572/1143] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:07 2022] GET /compute/v2.1/servers/20142887-e2ee-41f7-ad62-2e938b3c36f9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:24:08.805278 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ed484407-e4df-4469-9840-e9880a68f7ee tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:08.806281 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ed484407-e4df-4469-9840-e9880a68f7ee tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:08.812947 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ed484407-e4df-4469-9840-e9880a68f7ee tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:08.813396 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ed484407-e4df-4469-9840-e9880a68f7ee tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:08.814150 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ed484407-e4df-4469-9840-e9880a68f7ee tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:08.814626 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ed484407-e4df-4469-9840-e9880a68f7ee tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:08.843620 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ed484407-e4df-4469-9840-e9880a68f7ee tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042504 Jun 07 13:24:08.844181 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 572/1144] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:24:08 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:24:08.956956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e9b08f4c-c973-4c4e-a8dd-a88763f38b39 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:08.957945 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e9b08f4c-c973-4c4e-a8dd-a88763f38b39 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:08.964391 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e9b08f4c-c973-4c4e-a8dd-a88763f38b39 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:08.964845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e9b08f4c-c973-4c4e-a8dd-a88763f38b39 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:08.965600 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e9b08f4c-c973-4c4e-a8dd-a88763f38b39 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:08.966032 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e9b08f4c-c973-4c4e-a8dd-a88763f38b39 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:08.994825 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e9b08f4c-c973-4c4e-a8dd-a88763f38b39 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041769 Jun 07 13:24:08.995362 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 573/1145] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:24:08 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:24:09.051426 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-4c288198-8fc3-4f84-8ca4-9367d95ccfef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:09.051926 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-4c288198-8fc3-4f84-8ca4-9367d95ccfef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:09.057792 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4c288198-8fc3-4f84-8ca4-9367d95ccfef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:09.058238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4c288198-8fc3-4f84-8ca4-9367d95ccfef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:09.059039 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4c288198-8fc3-4f84-8ca4-9367d95ccfef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:09.059482 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4c288198-8fc3-4f84-8ca4-9367d95ccfef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:09.083812 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-4c288198-8fc3-4f84-8ca4-9367d95ccfef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Going to try to terminate instance {{(pid=117797) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:24:09.161172 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-4c288198-8fc3-4f84-8ca4-9367d95ccfef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 204 len: 0 microversion: 2.1 time: 0.113729 Jun 07 13:24:09.164835 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 573/1146] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:24:09 2022] DELETE /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:24:09.171766 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2c931197-1bf2-4a6c-9f7e-ce785f918959 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:09.172385 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2c931197-1bf2-4a6c-9f7e-ce785f918959 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:09.178310 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2c931197-1bf2-4a6c-9f7e-ce785f918959 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:09.178794 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2c931197-1bf2-4a6c-9f7e-ce785f918959 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:09.179564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2c931197-1bf2-4a6c-9f7e-ce785f918959 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:09.180004 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2c931197-1bf2-4a6c-9f7e-ce785f918959 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:09.307502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2c931197-1bf2-4a6c-9f7e-ce785f918959 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:09.314920 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2c931197-1bf2-4a6c-9f7e-ce785f918959 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1674 microversion: 2.1 time: 0.148511 Jun 07 13:24:09.315479 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 574/1147] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:09 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:10.333070 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-34153aad-d996-4f10-917c-5442cf034cc1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:10.333793 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-34153aad-d996-4f10-917c-5442cf034cc1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:10.340276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-34153aad-d996-4f10-917c-5442cf034cc1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:10.340727 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-34153aad-d996-4f10-917c-5442cf034cc1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:10.341485 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-34153aad-d996-4f10-917c-5442cf034cc1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:10.341924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-34153aad-d996-4f10-917c-5442cf034cc1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:10.466675 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-34153aad-d996-4f10-917c-5442cf034cc1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:10.474176 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-34153aad-d996-4f10-917c-5442cf034cc1 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1674 microversion: 2.1 time: 0.145882 Jun 07 13:24:10.474770 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 574/1148] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:10 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:11.491169 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2ab0ae14-7051-42f9-9a51-58486040c517 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:11.491766 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2ab0ae14-7051-42f9-9a51-58486040c517 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:11.498161 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ab0ae14-7051-42f9-9a51-58486040c517 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:11.498645 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ab0ae14-7051-42f9-9a51-58486040c517 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:11.499404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ab0ae14-7051-42f9-9a51-58486040c517 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:11.499840 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ab0ae14-7051-42f9-9a51-58486040c517 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:11.649493 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2ab0ae14-7051-42f9-9a51-58486040c517 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:11.657287 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2ab0ae14-7051-42f9-9a51-58486040c517 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1674 microversion: 2.1 time: 0.169966 Jun 07 13:24:11.657892 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 575/1149] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:11 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:12.674423 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9d1c46ea-01ad-4ddf-bacc-c36b8b246d85 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:12.675619 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9d1c46ea-01ad-4ddf-bacc-c36b8b246d85 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:12.682170 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9d1c46ea-01ad-4ddf-bacc-c36b8b246d85 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:12.682651 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9d1c46ea-01ad-4ddf-bacc-c36b8b246d85 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:12.683433 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9d1c46ea-01ad-4ddf-bacc-c36b8b246d85 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:12.683865 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9d1c46ea-01ad-4ddf-bacc-c36b8b246d85 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:12.812012 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9d1c46ea-01ad-4ddf-bacc-c36b8b246d85 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:12.819913 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9d1c46ea-01ad-4ddf-bacc-c36b8b246d85 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1674 microversion: 2.1 time: 0.149353 Jun 07 13:24:12.820477 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 575/1150] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:12 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:13.438755 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jun 07 13:24:13.439310 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Tue Jun 7 13:24:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:24:13.837256 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-acaf322e-3110-41b6-b01c-7dc1aa4638da tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:13.837879 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-acaf322e-3110-41b6-b01c-7dc1aa4638da tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:13.844226 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-acaf322e-3110-41b6-b01c-7dc1aa4638da tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:13.844674 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-acaf322e-3110-41b6-b01c-7dc1aa4638da tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:13.845432 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-acaf322e-3110-41b6-b01c-7dc1aa4638da tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:13.845866 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-acaf322e-3110-41b6-b01c-7dc1aa4638da tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:13.970774 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-acaf322e-3110-41b6-b01c-7dc1aa4638da tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:13.978757 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-acaf322e-3110-41b6-b01c-7dc1aa4638da tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1674 microversion: 2.1 time: 0.145326 Jun 07 13:24:13.979311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 576/1151] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:13 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:14.994890 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-7b12cf9a-a147-421e-8b3f-543d5e444c4f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:14.995503 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-7b12cf9a-a147-421e-8b3f-543d5e444c4f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:15.002044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7b12cf9a-a147-421e-8b3f-543d5e444c4f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:15.002521 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7b12cf9a-a147-421e-8b3f-543d5e444c4f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:15.003361 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7b12cf9a-a147-421e-8b3f-543d5e444c4f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:15.003804 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-7b12cf9a-a147-421e-8b3f-543d5e444c4f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:15.134216 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-7b12cf9a-a147-421e-8b3f-543d5e444c4f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:15.141774 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-7b12cf9a-a147-421e-8b3f-543d5e444c4f tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1674 microversion: 2.1 time: 0.150737 Jun 07 13:24:15.142344 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 576/1152] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:14 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:15.418338 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-4ba4e800-9c87-47f4-b12f-6e637ed73d1e req-02b7572e-68a7-4931-b15c-ea3f0db66a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e529399b-e8ad-4d23-8b5d-6d6633ebf04c", "name": "network-vif-deleted", "tag": "ad86f27e-afe4-4ff9-854c-46f40fe5246c"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:15.429744 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-4ba4e800-9c87-47f4-b12f-6e637ed73d1e req-02b7572e-68a7-4931-b15c-ea3f0db66a79 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:15.430296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-4ba4e800-9c87-47f4-b12f-6e637ed73d1e req-02b7572e-68a7-4931-b15c-ea3f0db66a79 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:15.446509 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-4ba4e800-9c87-47f4-b12f-6e637ed73d1e req-02b7572e-68a7-4931-b15c-ea3f0db66a79 service nova] Creating event network-vif-deleted:ad86f27e-afe4-4ff9-854c-46f40fe5246c for instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c on hv-cinder-84496 Jun 07 13:24:15.451603 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-4ba4e800-9c87-47f4-b12f-6e637ed73d1e req-02b7572e-68a7-4931-b15c-ea3f0db66a79 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037374 Jun 07 13:24:15.452350 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 577/1153] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:16.159184 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f0647fbd-3f13-4e37-b00a-e48e5b15b85b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:16.160530 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f0647fbd-3f13-4e37-b00a-e48e5b15b85b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:16.167370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f0647fbd-3f13-4e37-b00a-e48e5b15b85b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:16.167900 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f0647fbd-3f13-4e37-b00a-e48e5b15b85b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:16.168777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f0647fbd-3f13-4e37-b00a-e48e5b15b85b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:16.169285 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f0647fbd-3f13-4e37-b00a-e48e5b15b85b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:16.188078 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:16.234644 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f0647fbd-3f13-4e37-b00a-e48e5b15b85b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:16.242504 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f0647fbd-3f13-4e37-b00a-e48e5b15b85b tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1607 microversion: 2.1 time: 0.087186 Jun 07 13:24:16.243418 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 577/1154] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:16 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1607 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:17.260559 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ddbfe8a8-ea62-4f29-b391-f3adfeb45a82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:17.261177 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ddbfe8a8-ea62-4f29-b391-f3adfeb45a82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:17.267404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ddbfe8a8-ea62-4f29-b391-f3adfeb45a82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:17.267857 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ddbfe8a8-ea62-4f29-b391-f3adfeb45a82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:17.268711 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ddbfe8a8-ea62-4f29-b391-f3adfeb45a82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:17.269218 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ddbfe8a8-ea62-4f29-b391-f3adfeb45a82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:17.332693 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ddbfe8a8-ea62-4f29-b391-f3adfeb45a82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:17.340401 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ddbfe8a8-ea62-4f29-b391-f3adfeb45a82 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1323 microversion: 2.1 time: 0.084693 Jun 07 13:24:17.340966 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 578/1155] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:17 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1323 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:18.357461 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-44efeebb-63b2-44d5-b098-4aa109831a72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:18.358077 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-44efeebb-63b2-44d5-b098-4aa109831a72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:18.364646 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-44efeebb-63b2-44d5-b098-4aa109831a72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:18.365102 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-44efeebb-63b2-44d5-b098-4aa109831a72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:18.365869 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-44efeebb-63b2-44d5-b098-4aa109831a72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:18.366304 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-44efeebb-63b2-44d5-b098-4aa109831a72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:18.396214 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-44efeebb-63b2-44d5-b098-4aa109831a72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:18.396663 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-44efeebb-63b2-44d5-b098-4aa109831a72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:18.397108 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-44efeebb-63b2-44d5-b098-4aa109831a72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lazy-loading 'fault' on Instance uuid e529399b-e8ad-4d23-8b5d-6d6633ebf04c {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:24:18.439643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-44efeebb-63b2-44d5-b098-4aa109831a72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a46709afbe46cbb93f6e2a1760d0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e8fd59ba6046ad9185164e19c0be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:18.447096 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-44efeebb-63b2-44d5-b098-4aa109831a72 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 200 len: 1328 microversion: 2.1 time: 0.093561 Jun 07 13:24:18.447664 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 578/1156] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:18 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 1328 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:19.464936 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a322cd54-7ce0-4b80-b4c9-3bde24590327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:19.465548 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a322cd54-7ce0-4b80-b4c9-3bde24590327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:19.472542 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a322cd54-7ce0-4b80-b4c9-3bde24590327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:19.472987 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a322cd54-7ce0-4b80-b4c9-3bde24590327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:19.473738 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a322cd54-7ce0-4b80-b4c9-3bde24590327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:19.474168 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a322cd54-7ce0-4b80-b4c9-3bde24590327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:19.478122 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:19.488951 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-a322cd54-7ce0-4b80-b4c9-3bde24590327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] HTTP exception thrown: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a322cd54-7ce0-4b80-b4c9-3bde24590327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Request method failure captured: Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c HTTP/1.1 Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08bsYO-BvBobA841eqMlyF3MFUEu4iP30pVur_VBb2tT4Ia_nfGelqxEaCrgyJ84Z3DC7fic-hUg0YehCxIg4YXd4XPxDGrg6mHPq77spHg3NchTTTEPU1_Ch2_ataADNmKBOvdUv5UhQPVUchzg4BWB0XV6W2miEeaJil88m3nMQo Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 42e8fd59ba6046ad9185164e19c0be0f Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:24:19.490796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:24:19.492417 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_42e8fd59ba6046ad9185164e19c0be0f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:24:19.492417 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:24:19.492417 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 42e8fd59ba6046ad9185164e19c0be0f Jun 07 13:24:19.492417 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:24:19.492417 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeTestJSON-1780116012-project Jun 07 13:24:19.492417 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:24:19.492417 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:24:19.492417 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 40a46709afbe46cbb93f6e2a1760d0c5 Jun 07 13:24:19.492417 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeTestJSON-1780116012-project Jun 07 13:24:19.492417 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:24:19.492417 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. Jun 07 13:24:19.492417 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': 'e529399b-e8ad-4d23-8b5d-6d6633ebf04c'} Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:24:19.493498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. Jun 07 13:24:19.495001 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:19.496512 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a322cd54-7ce0-4b80-b4c9-3bde24590327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Returning 404 to user: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:24:19.496512 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a322cd54-7ce0-4b80-b4c9-3bde24590327 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 404 len: 111 microversion: 2.1 time: 0.031104 Jun 07 13:24:19.496512 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 579/1157] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:19 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:24:19.500846 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1763c25d-b62c-4c9e-90ae-12e82c595762 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '.version_select at 0x7fb8e7986700>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:19.506458 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:19.519145 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1763c25d-b62c-4c9e-90ae-12e82c595762 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1077558605" status: 202 len: 0 microversion: 2.1 time: 0.022104 Jun 07 13:24:19.519727 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 579/1158] 10.222.0.58 () {58 vars in 1220 bytes} [Tue Jun 7 13:24:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1077558605 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:24:19.592317 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b13bc3fe-af82-4a94-b608-a65771473c10 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-614851779", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452", "networks": [{"uuid": "553d5a11-f4b5-4bc5-b12e-e8f0b81a3dfb"}]}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:19.647459 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-b13bc3fe-af82-4a94-b608-a65771473c10 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] validate_networks() for [('553d5a11-f4b5-4bc5-b12e-e8f0b81a3dfb', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:24:20.022690 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-b13bc3fe-af82-4a94-b608-a65771473c10 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:24:20.023118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-b13bc3fe-af82-4a94-b608-a65771473c10 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:24:20.023597 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-b13bc3fe-af82-4a94-b608-a65771473c10 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:24:20.024010 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-b13bc3fe-af82-4a94-b608-a65771473c10 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:24:20.024447 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-b13bc3fe-af82-4a94-b608-a65771473c10 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:24:20.034031 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b13bc3fe-af82-4a94-b608-a65771473c10 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:20.034529 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b13bc3fe-af82-4a94-b608-a65771473c10 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:20.035320 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b13bc3fe-af82-4a94-b608-a65771473c10 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:20.035761 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b13bc3fe-af82-4a94-b608-a65771473c10 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:20.053508 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-b13bc3fe-af82-4a94-b608-a65771473c10 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Getting quotas for project 14800dce94ee42638e6335472a0a46a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:24:20.057695 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-b13bc3fe-af82-4a94-b608-a65771473c10 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Getting quotas for user 2520416576534123979c732a6837a368 and project 14800dce94ee42638e6335472a0a46a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:24:20.069602 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b13bc3fe-af82-4a94-b608-a65771473c10 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:24:20.071919 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b13bc3fe-af82-4a94-b608-a65771473c10 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:24:20.125677 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b13bc3fe-af82-4a94-b608-a65771473c10 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537199 Jun 07 13:24:20.126671 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 580/1159] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:24:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:24:20.139416 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b497b567-ef4a-46b3-8fe3-3f0a55c409fc tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:20.140281 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b497b567-ef4a-46b3-8fe3-3f0a55c409fc tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:20.281755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b497b567-ef4a-46b3-8fe3-3f0a55c409fc tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:20.292060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b497b567-ef4a-46b3-8fe3-3f0a55c409fc tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1218 microversion: 2.1 time: 0.157312 Jun 07 13:24:20.292644 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 580/1160] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:20 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:21.309457 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-da8af1c0-7241-469d-9301-c97d503514e0 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:21.310078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-da8af1c0-7241-469d-9301-c97d503514e0 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:21.318990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da8af1c0-7241-469d-9301-c97d503514e0 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:21.319440 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da8af1c0-7241-469d-9301-c97d503514e0 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:21.320213 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da8af1c0-7241-469d-9301-c97d503514e0 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:21.320651 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da8af1c0-7241-469d-9301-c97d503514e0 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:21.387299 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-da8af1c0-7241-469d-9301-c97d503514e0 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:21.396304 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-da8af1c0-7241-469d-9301-c97d503514e0 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1276 microversion: 2.1 time: 0.091711 Jun 07 13:24:21.397075 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 581/1161] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:21 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:22.413966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3788c459-31b9-4e5e-b92c-abfdb8c66fce tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:22.414416 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3788c459-31b9-4e5e-b92c-abfdb8c66fce tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:22.421135 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3788c459-31b9-4e5e-b92c-abfdb8c66fce tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:22.421589 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3788c459-31b9-4e5e-b92c-abfdb8c66fce tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:22.422390 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3788c459-31b9-4e5e-b92c-abfdb8c66fce tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:22.422854 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3788c459-31b9-4e5e-b92c-abfdb8c66fce tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:22.540354 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-c872c61f-2e09-4f59-adde-00e6cf6c96a9 req-0934b28a-a3e1-4e21-af2f-0ee2729444fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1e65356-8724-4b15-8c81-ef58fc603b84", "tag": "3c9bb8c5-a933-4801-9cf5-e8a2eba38d2d"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:22.551135 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-c872c61f-2e09-4f59-adde-00e6cf6c96a9 req-0934b28a-a3e1-4e21-af2f-0ee2729444fd service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:22.551962 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-c872c61f-2e09-4f59-adde-00e6cf6c96a9 req-0934b28a-a3e1-4e21-af2f-0ee2729444fd service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:22.563461 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3788c459-31b9-4e5e-b92c-abfdb8c66fce tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:22.563990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-c872c61f-2e09-4f59-adde-00e6cf6c96a9 req-0934b28a-a3e1-4e21-af2f-0ee2729444fd service nova] Creating event network-changed:3c9bb8c5-a933-4801-9cf5-e8a2eba38d2d for instance a1e65356-8724-4b15-8c81-ef58fc603b84 on hv-cinder-84496 Jun 07 13:24:22.569535 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-c872c61f-2e09-4f59-adde-00e6cf6c96a9 req-0934b28a-a3e1-4e21-af2f-0ee2729444fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032406 Jun 07 13:24:22.570279 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 582/1162] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:24:22.572626 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3788c459-31b9-4e5e-b92c-abfdb8c66fce tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1318 microversion: 2.1 time: 0.163236 Jun 07 13:24:22.573347 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 581/1163] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:22 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:22.688750 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7116586d-d919-466e-989d-07ea911eb081 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:22.689376 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7116586d-d919-466e-989d-07ea911eb081 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:22.695647 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7116586d-d919-466e-989d-07ea911eb081 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:22.696103 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7116586d-d919-466e-989d-07ea911eb081 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:22.696875 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7116586d-d919-466e-989d-07ea911eb081 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:22.697318 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7116586d-d919-466e-989d-07ea911eb081 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:22.711049 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-7116586d-d919-466e-989d-07ea911eb081 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] HTTP exception thrown: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7116586d-d919-466e-989d-07ea911eb081 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Request method failure captured: Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: DELETE /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c HTTP/1.1 Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08bsYO-BvBobA841eqMlyF3MFUEu4iP30pVur_VBb2tT4Ia_nfGelqxEaCrgyJ84Z3DC7fic-hUg0YehCxIg4YXd4XPxDGrg6mHPq77spHg3NchTTTEPU1_Ch2_ataADNmKBOvdUv5UhQPVUchzg4BWB0XV6W2miEeaJil88m3nMQo Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 42e8fd59ba6046ad9185164e19c0be0f Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:24:22.712741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:24:22.714340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_42e8fd59ba6046ad9185164e19c0be0f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:24:22.714340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:24:22.714340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 42e8fd59ba6046ad9185164e19c0be0f Jun 07 13:24:22.714340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:24:22.714340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeTestJSON-1780116012-project Jun 07 13:24:22.714340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:24:22.714340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:24:22.714340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 40a46709afbe46cbb93f6e2a1760d0c5 Jun 07 13:24:22.714340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeTestJSON-1780116012-project Jun 07 13:24:22.714340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:24:22.714340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. Jun 07 13:24:22.714340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': 'e529399b-e8ad-4d23-8b5d-6d6633ebf04c'} Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:24:22.715302 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. Jun 07 13:24:22.716753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:22.718206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7116586d-d919-466e-989d-07ea911eb081 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Returning 404 to user: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:24:22.718206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7116586d-d919-466e-989d-07ea911eb081 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 404 len: 111 microversion: 2.1 time: 0.029735 Jun 07 13:24:22.718206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 583/1164] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:24:22 2022] DELETE /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:24:22.727117 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c2066870-ca9f-4228-a520-41fc2fca97ef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:22.727729 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c2066870-ca9f-4228-a520-41fc2fca97ef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: e529399b-e8ad-4d23-8b5d-6d6633ebf04c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:22.733680 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c2066870-ca9f-4228-a520-41fc2fca97ef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:22.734128 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c2066870-ca9f-4228-a520-41fc2fca97ef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:22.734983 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c2066870-ca9f-4228-a520-41fc2fca97ef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:22.735341 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c2066870-ca9f-4228-a520-41fc2fca97ef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:22.749279 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-c2066870-ca9f-4228-a520-41fc2fca97ef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] HTTP exception thrown: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c2066870-ca9f-4228-a520-41fc2fca97ef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Request method failure captured: Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c HTTP/1.1 Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08bsYO-BvBobA841eqMlyF3MFUEu4iP30pVur_VBb2tT4Ia_nfGelqxEaCrgyJ84Z3DC7fic-hUg0YehCxIg4YXd4XPxDGrg6mHPq77spHg3NchTTTEPU1_Ch2_ataADNmKBOvdUv5UhQPVUchzg4BWB0XV6W2miEeaJil88m3nMQo Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 42e8fd59ba6046ad9185164e19c0be0f Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:24:22.750976 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:24:22.752290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_42e8fd59ba6046ad9185164e19c0be0f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:24:22.752290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:24:22.752290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 42e8fd59ba6046ad9185164e19c0be0f Jun 07 13:24:22.752290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:24:22.752290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-AttachVolumeTestJSON-1780116012-project Jun 07 13:24:22.752290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:24:22.752290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:24:22.752290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 40a46709afbe46cbb93f6e2a1760d0c5 Jun 07 13:24:22.752290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-AttachVolumeTestJSON-1780116012-project Jun 07 13:24:22.752290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:24:22.752290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. Jun 07 13:24:22.752290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': 'e529399b-e8ad-4d23-8b5d-6d6633ebf04c'} Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:24:22.753276 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. Jun 07 13:24:22.754737 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:22.756553 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c2066870-ca9f-4228-a520-41fc2fca97ef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Returning 404 to user: Instance e529399b-e8ad-4d23-8b5d-6d6633ebf04c could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:24:22.756553 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c2066870-ca9f-4228-a520-41fc2fca97ef tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c" status: 404 len: 111 microversion: 2.1 time: 0.029135 Jun 07 13:24:22.756553 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 582/1165] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:22 2022] GET /compute/v2.1/servers/e529399b-e8ad-4d23-8b5d-6d6633ebf04c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:24:23.589832 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6216d077-37bc-4662-bec6-2a3dacb90cfd tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:23.590483 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6216d077-37bc-4662-bec6-2a3dacb90cfd tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:23.597048 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6216d077-37bc-4662-bec6-2a3dacb90cfd tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:23.597499 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6216d077-37bc-4662-bec6-2a3dacb90cfd tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:23.598267 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6216d077-37bc-4662-bec6-2a3dacb90cfd tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:23.598738 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6216d077-37bc-4662-bec6-2a3dacb90cfd tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:23.733583 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6216d077-37bc-4662-bec6-2a3dacb90cfd tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:23.741599 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6216d077-37bc-4662-bec6-2a3dacb90cfd tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1318 microversion: 2.1 time: 0.155661 Jun 07 13:24:23.742166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 584/1166] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:23 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:23.917743 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d82f20e2-6bb1-47a5-b80f-a9d552f9ca61 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:23.918248 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-d82f20e2-6bb1-47a5-b80f-a9d552f9ca61 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:23.924659 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d82f20e2-6bb1-47a5-b80f-a9d552f9ca61 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:23.925767 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d82f20e2-6bb1-47a5-b80f-a9d552f9ca61 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:23.926554 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d82f20e2-6bb1-47a5-b80f-a9d552f9ca61 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:23.927002 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-d82f20e2-6bb1-47a5-b80f-a9d552f9ca61 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:23.940094 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-d82f20e2-6bb1-47a5-b80f-a9d552f9ca61 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] HTTP exception thrown: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d82f20e2-6bb1-47a5-b80f-a9d552f9ca61 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Request method failure captured: Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: DELETE /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca HTTP/1.1 Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08bsYO-BvBobA841eqMlyF3MFUEu4iP30pVur_VBb2tT4Ia_nfGelqxEaCrgyJ84Z3DC7fic-hUg0YehCxIg4YXd4XPxDGrg6mHPq77spHg3NchTTTEPU1_Ch2_ataADNmKBOvdUv5UhQPVUchzg4BWB0XV6W2miEeaJil88m3nMQo Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 42e8fd59ba6046ad9185164e19c0be0f Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:24:23.941597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:24:23.943302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_42e8fd59ba6046ad9185164e19c0be0f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:24:23.943302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:24:23.943302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 42e8fd59ba6046ad9185164e19c0be0f Jun 07 13:24:23.943302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:24:23.943302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-AttachVolumeTestJSON-1780116012-project Jun 07 13:24:23.943302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:24:23.943302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:24:23.943302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 40a46709afbe46cbb93f6e2a1760d0c5 Jun 07 13:24:23.943302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-AttachVolumeTestJSON-1780116012-project Jun 07 13:24:23.943302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:24:23.943302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. Jun 07 13:24:23.943302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': 'dec72c48-4900-4d75-8fca-c5b6f5a287ca'} Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:24:23.944241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. Jun 07 13:24:23.945777 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:23.947378 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-d82f20e2-6bb1-47a5-b80f-a9d552f9ca61 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Returning 404 to user: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:24:23.947378 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-d82f20e2-6bb1-47a5-b80f-a9d552f9ca61 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 404 len: 111 microversion: 2.1 time: 0.029061 Jun 07 13:24:23.947378 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 583/1167] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:24:23 2022] DELETE /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:24:23.951189 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bbb34e49-4d4f-43d0-be3a-bb5ac4d1b177 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:23.951804 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bbb34e49-4d4f-43d0-be3a-bb5ac4d1b177 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] [instance: dec72c48-4900-4d75-8fca-c5b6f5a287ca] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:23.957781 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bbb34e49-4d4f-43d0-be3a-bb5ac4d1b177 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:23.958242 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bbb34e49-4d4f-43d0-be3a-bb5ac4d1b177 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:23.959027 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bbb34e49-4d4f-43d0-be3a-bb5ac4d1b177 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:23.959463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bbb34e49-4d4f-43d0-be3a-bb5ac4d1b177 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:23.972794 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-bbb34e49-4d4f-43d0-be3a-bb5ac4d1b177 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] HTTP exception thrown: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bbb34e49-4d4f-43d0-be3a-bb5ac4d1b177 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Request method failure captured: Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca HTTP/1.1 Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08bsYO-BvBobA841eqMlyF3MFUEu4iP30pVur_VBb2tT4Ia_nfGelqxEaCrgyJ84Z3DC7fic-hUg0YehCxIg4YXd4XPxDGrg6mHPq77spHg3NchTTTEPU1_Ch2_ataADNmKBOvdUv5UhQPVUchzg4BWB0XV6W2miEeaJil88m3nMQo Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 42e8fd59ba6046ad9185164e19c0be0f Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:24:23.974282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:24:23.975862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_42e8fd59ba6046ad9185164e19c0be0f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/42e8fd59ba6046ad9185164e19c0be0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:24:23.975862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:24:23.975862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 42e8fd59ba6046ad9185164e19c0be0f Jun 07 13:24:23.975862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1780116012 Jun 07 13:24:23.975862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeTestJSON-1780116012-project Jun 07 13:24:23.975862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:24:23.975862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:24:23.975862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 40a46709afbe46cbb93f6e2a1760d0c5 Jun 07 13:24:23.975862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeTestJSON-1780116012-project Jun 07 13:24:23.975862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:24:23.975862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. Jun 07 13:24:23.975862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': 'dec72c48-4900-4d75-8fca-c5b6f5a287ca'} Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:24:23.976673 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. Jun 07 13:24:23.977873 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:23.979017 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bbb34e49-4d4f-43d0-be3a-bb5ac4d1b177 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] Returning 404 to user: Instance dec72c48-4900-4d75-8fca-c5b6f5a287ca could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:24:23.979017 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bbb34e49-4d4f-43d0-be3a-bb5ac4d1b177 tempest-AttachVolumeTestJSON-1780116012 tempest-AttachVolumeTestJSON-1780116012-project] 10.222.0.58 "GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca" status: 404 len: 111 microversion: 2.1 time: 0.028304 Jun 07 13:24:23.979017 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 585/1168] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:23 2022] GET /compute/v2.1/servers/dec72c48-4900-4d75-8fca-c5b6f5a287ca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:24:24.758875 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-53c912ad-4702-4732-b1ee-53b4385944a6 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:24.759495 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-53c912ad-4702-4732-b1ee-53b4385944a6 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:24.765624 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-53c912ad-4702-4732-b1ee-53b4385944a6 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:24.766075 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-53c912ad-4702-4732-b1ee-53b4385944a6 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:24.766882 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-53c912ad-4702-4732-b1ee-53b4385944a6 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:24.767329 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-53c912ad-4702-4732-b1ee-53b4385944a6 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:24.974657 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-53c912ad-4702-4732-b1ee-53b4385944a6 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:24.983884 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-53c912ad-4702-4732-b1ee-53b4385944a6 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1318 microversion: 2.1 time: 0.228849 Jun 07 13:24:24.984552 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 584/1169] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:24 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:26.001107 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-49ccad95-092a-4b69-b4be-3c11eea4e112 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:26.001741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-49ccad95-092a-4b69-b4be-3c11eea4e112 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:26.008751 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-49ccad95-092a-4b69-b4be-3c11eea4e112 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:26.009204 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-49ccad95-092a-4b69-b4be-3c11eea4e112 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:26.009976 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-49ccad95-092a-4b69-b4be-3c11eea4e112 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:26.010416 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-49ccad95-092a-4b69-b4be-3c11eea4e112 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:26.220202 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-49ccad95-092a-4b69-b4be-3c11eea4e112 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:26.230660 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-49ccad95-092a-4b69-b4be-3c11eea4e112 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1318 microversion: 2.1 time: 0.233256 Jun 07 13:24:26.231900 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 586/1170] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:25 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:27.248068 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-2a9f6dfd-eaad-4ba6-bde2-6b2e0c02cd89 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:27.248676 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-2a9f6dfd-eaad-4ba6-bde2-6b2e0c02cd89 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:27.255289 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2a9f6dfd-eaad-4ba6-bde2-6b2e0c02cd89 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:27.255734 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2a9f6dfd-eaad-4ba6-bde2-6b2e0c02cd89 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:27.256581 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2a9f6dfd-eaad-4ba6-bde2-6b2e0c02cd89 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:27.257013 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2a9f6dfd-eaad-4ba6-bde2-6b2e0c02cd89 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:27.384302 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-2a9f6dfd-eaad-4ba6-bde2-6b2e0c02cd89 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:27.391624 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-2a9f6dfd-eaad-4ba6-bde2-6b2e0c02cd89 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1318 microversion: 2.1 time: 0.147757 Jun 07 13:24:27.392192 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 585/1171] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:27 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:28.227397 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3deb3693-30b7-48f1-8973-aa0c938f4ab9 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Action: 'create', calling method: .version_select at 0x7fb8f8fcd820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1416685849", "metadata": {"Type": "work"}}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3deb3693-30b7-48f1-8973-aa0c938f4ab9 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Request method failure captured: Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 122 Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin1GMDU-ZgSawvbx0d3dqAp8sU3433BokfL91CgMgMI3QmXIhjeiTE7Dw006AAuLPSiwJx9aSqDOQJYpFQ3qUGlM-NvJ16gTfV1geTCt7tOdbhy_LppQeDwNyH3o4q5WyOn_KNmsOvyHet3PLfJl3XZr-tijtgAlRdbmDgZ-0R4KKBl8 Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: cf9bf7e3024d48ccaaabc5ec4e56b3c0 Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:24:28.245137 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:24:28.246635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cf9bf7e3024d48ccaaabc5ec4e56b3c0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:24:28.246635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.246635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: cf9bf7e3024d48ccaaabc5ec4e56b3c0 Jun 07 13:24:28.246635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.246635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-VolumesNegativeTest-125473673-project Jun 07 13:24:28.246635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:24:28.246635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:24:28.246635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 040ee92f471b409baa8a8a01dd0ddda4 Jun 07 13:24:28.246635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-VolumesNegativeTest-125473673-project Jun 07 13:24:28.246635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Jun 07 13:24:28.246635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1416685849", "metadata": {"Type": "work"}}} Jun 07 13:24:28.246635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: Jun 07 13:24:28.246635 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1416685849', 'metadata': {'Type': 'work'}}}} Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise error Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi '#$%' Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:24:28.247481 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 13:24:28.248990 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 13:24:28.250147 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 13:24:28.250147 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.250147 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3deb3693-30b7-48f1-8973-aa0c938f4ab9 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:24:28.250147 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3deb3693-30b7-48f1-8973-aa0c938f4ab9 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132396 Jun 07 13:24:28.250147 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 587/1172] 10.222.0.58 () {60 vars in 1155 bytes} [Tue Jun 7 13:24:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:24:28.256474 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0ce9fb24-060f-4db4-ac6c-51f5258789d0 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Action: 'create', calling method: .version_select at 0x7fb8f8ec90d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-270825347", "metadata": {"Type": "work"}}} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0ce9fb24-060f-4db4-ac6c-51f5258789d0 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Request method failure captured: Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 119 Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin1GMDU-ZgSawvbx0d3dqAp8sU3433BokfL91CgMgMI3QmXIhjeiTE7Dw006AAuLPSiwJx9aSqDOQJYpFQ3qUGlM-NvJ16gTfV1geTCt7tOdbhy_LppQeDwNyH3o4q5WyOn_KNmsOvyHet3PLfJl3XZr-tijtgAlRdbmDgZ-0R4KKBl8 Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: cf9bf7e3024d48ccaaabc5ec4e56b3c0 Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:24:28.259733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:24:28.261439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cf9bf7e3024d48ccaaabc5ec4e56b3c0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:24:28.261439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.261439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: cf9bf7e3024d48ccaaabc5ec4e56b3c0 Jun 07 13:24:28.261439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.261439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-VolumesNegativeTest-125473673-project Jun 07 13:24:28.261439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:24:28.261439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:24:28.261439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 040ee92f471b409baa8a8a01dd0ddda4 Jun 07 13:24:28.261439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-VolumesNegativeTest-125473673-project Jun 07 13:24:28.261439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Jun 07 13:24:28.261439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-270825347", "metadata": {"Type": "work"}}} Jun 07 13:24:28.261439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: Jun 07 13:24:28.261439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-270825347', 'metadata': {'Type': 'work'}}}} Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise error Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi '0' Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:24:28.262555 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 13:24:28.264273 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 13:24:28.265643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 13:24:28.265643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.265643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0ce9fb24-060f-4db4-ac6c-51f5258789d0 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:24:28.265643 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0ce9fb24-060f-4db4-ac6c-51f5258789d0 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008584 Jun 07 13:24:28.266690 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 586/1173] 10.222.0.58 () {60 vars in 1155 bytes} [Tue Jun 7 13:24:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:24:28.274118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-14cd6db3-e6e2-4b78-b3a1-f1d3cc936026 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Action: 'create', calling method: .version_select at 0x7fb8f8f6ac10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-681745157", "metadata": {"Type": "work"}}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-14cd6db3-e6e2-4b78-b3a1-f1d3cc936026 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Request method failure captured: Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 118 Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin1GMDU-ZgSawvbx0d3dqAp8sU3433BokfL91CgMgMI3QmXIhjeiTE7Dw006AAuLPSiwJx9aSqDOQJYpFQ3qUGlM-NvJ16gTfV1geTCt7tOdbhy_LppQeDwNyH3o4q5WyOn_KNmsOvyHet3PLfJl3XZr-tijtgAlRdbmDgZ-0R4KKBl8 Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: cf9bf7e3024d48ccaaabc5ec4e56b3c0 Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:24:28.276958 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:24:28.278638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cf9bf7e3024d48ccaaabc5ec4e56b3c0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:24:28.278638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.278638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: cf9bf7e3024d48ccaaabc5ec4e56b3c0 Jun 07 13:24:28.278638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.278638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-VolumesNegativeTest-125473673-project Jun 07 13:24:28.278638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:24:28.278638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:24:28.278638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 040ee92f471b409baa8a8a01dd0ddda4 Jun 07 13:24:28.278638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-VolumesNegativeTest-125473673-project Jun 07 13:24:28.278638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Jun 07 13:24:28.278638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-681745157", "metadata": {"Type": "work"}}} Jun 07 13:24:28.278638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: Jun 07 13:24:28.278638 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-681745157', 'metadata': {'Type': 'work'}}}} Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise error Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi '' Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:24:28.279697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 13:24:28.281370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 13:24:28.282876 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 13:24:28.282876 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.282876 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-14cd6db3-e6e2-4b78-b3a1-f1d3cc936026 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:24:28.282876 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-14cd6db3-e6e2-4b78-b3a1-f1d3cc936026 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008814 Jun 07 13:24:28.282876 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 588/1174] 10.222.0.58 () {60 vars in 1155 bytes} [Tue Jun 7 13:24:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:24:28.289206 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c2f2b8bf-7d1e-4258-9630-3edff0397977 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Calling method '.version_select at 0x7fb8e7986940>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:28.319114 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-c2f2b8bf-7d1e-4258-9630-3edff0397977 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] HTTP exception thrown: Volume tempest-invalid-1187829543 could not be found. Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c2f2b8bf-7d1e-4258-9630-3edff0397977 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Request method failure captured: Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1187829543 HTTP/1.1 Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin1GMDU-ZgSawvbx0d3dqAp8sU3433BokfL91CgMgMI3QmXIhjeiTE7Dw006AAuLPSiwJx9aSqDOQJYpFQ3qUGlM-NvJ16gTfV1geTCt7tOdbhy_LppQeDwNyH3o4q5WyOn_KNmsOvyHet3PLfJl3XZr-tijtgAlRdbmDgZ-0R4KKBl8 Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: cf9bf7e3024d48ccaaabc5ec4e56b3c0 Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:24:28.321256 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:24:28.322851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cf9bf7e3024d48ccaaabc5ec4e56b3c0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:24:28.322851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.322851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: cf9bf7e3024d48ccaaabc5ec4e56b3c0 Jun 07 13:24:28.322851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.322851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-VolumesNegativeTest-125473673-project Jun 07 13:24:28.322851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:24:28.322851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:24:28.322851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 040ee92f471b409baa8a8a01dd0ddda4 Jun 07 13:24:28.322851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-VolumesNegativeTest-125473673-project Jun 07 13:24:28.322851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: Jun 07 13:24:28.322851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Volume tempest-invalid-1187829543 could not be found. Jun 07 13:24:28.322851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': 'tempest-invalid-1187829543'} Jun 07 13:24:28.322851 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1187829543 could not be found. (HTTP 404) (Request-ID: req-f67b9de8-34c3-428b-8ba2-e2e00bb6a5fe) Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:28.323755 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:24:28.324966 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1187829543 could not be found. Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:24:28.326535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1187829543 could not be found. Jun 07 13:24:28.328265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.328265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:28.328265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.328265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.328265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:28.328265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:28.328265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:24:28.328265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:24:28.328265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1187829543 could not be found. Jun 07 13:24:28.328265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.328265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c2f2b8bf-7d1e-4258-9630-3edff0397977 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Returning 404 to user: Volume tempest-invalid-1187829543 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:24:28.328265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c2f2b8bf-7d1e-4258-9630-3edff0397977 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1187829543" status: 404 len: 99 microversion: 2.1 time: 0.040225 Jun 07 13:24:28.328265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 587/1175] 10.222.0.58 () {58 vars in 1217 bytes} [Tue Jun 7 13:24:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1187829543 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 07 13:24:28.336092 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3e29ea7c-e6a4-437e-ab7a-7d0af7f5b318 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004675 Jun 07 13:24:28.336584 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 589/1176] 10.222.0.58 () {58 vars in 1139 bytes} [Tue Jun 7 13:24:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 13:24:28.345086 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-37397810-ea4b-4917-a286-a7839e90508a tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003821 Jun 07 13:24:28.345702 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 588/1177] 10.222.0.58 () {58 vars in 1136 bytes} [Tue Jun 7 13:24:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 13:24:28.355360 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f75c6375-4065-400f-b990-86982e1e765f tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Calling method '.version_select at 0x7fb8f8f6a040>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:28.384954 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-f75c6375-4065-400f-b990-86982e1e765f tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] HTTP exception thrown: Volume d202f1c5-19c0-47f9-96bb-08e62f257666 could not be found. Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f75c6375-4065-400f-b990-86982e1e765f tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Request method failure captured: Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: DELETE /compute/v2.1/os-volumes/d202f1c5-19c0-47f9-96bb-08e62f257666 HTTP/1.1 Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin1GMDU-ZgSawvbx0d3dqAp8sU3433BokfL91CgMgMI3QmXIhjeiTE7Dw006AAuLPSiwJx9aSqDOQJYpFQ3qUGlM-NvJ16gTfV1geTCt7tOdbhy_LppQeDwNyH3o4q5WyOn_KNmsOvyHet3PLfJl3XZr-tijtgAlRdbmDgZ-0R4KKBl8 Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: cf9bf7e3024d48ccaaabc5ec4e56b3c0 Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:24:28.386953 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:24:28.388399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cf9bf7e3024d48ccaaabc5ec4e56b3c0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:24:28.388399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.388399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: cf9bf7e3024d48ccaaabc5ec4e56b3c0 Jun 07 13:24:28.388399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.388399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-VolumesNegativeTest-125473673-project Jun 07 13:24:28.388399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:24:28.388399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:24:28.388399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 040ee92f471b409baa8a8a01dd0ddda4 Jun 07 13:24:28.388399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-VolumesNegativeTest-125473673-project Jun 07 13:24:28.388399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: Jun 07 13:24:28.388399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Volume d202f1c5-19c0-47f9-96bb-08e62f257666 could not be found. Jun 07 13:24:28.388399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': 'd202f1c5-19c0-47f9-96bb-08e62f257666'} Jun 07 13:24:28.388399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d202f1c5-19c0-47f9-96bb-08e62f257666 could not be found. (HTTP 404) (Request-ID: req-5e5cb07e-5c02-43d1-9dd6-f7f8db3ccaf2) Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:28.389665 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:24:28.390964 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d202f1c5-19c0-47f9-96bb-08e62f257666 could not be found. Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 13:24:28.392786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:24:28.394708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d202f1c5-19c0-47f9-96bb-08e62f257666 could not be found. Jun 07 13:24:28.394708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.394708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:28.394708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.394708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.394708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:28.394708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:28.394708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:24:28.394708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:24:28.394708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d202f1c5-19c0-47f9-96bb-08e62f257666 could not be found. Jun 07 13:24:28.394708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.394708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f75c6375-4065-400f-b990-86982e1e765f tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Returning 404 to user: Volume d202f1c5-19c0-47f9-96bb-08e62f257666 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:24:28.394708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f75c6375-4065-400f-b990-86982e1e765f tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/d202f1c5-19c0-47f9-96bb-08e62f257666" status: 404 len: 109 microversion: 2.1 time: 0.036881 Jun 07 13:24:28.394708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 590/1178] 10.222.0.58 () {58 vars in 1247 bytes} [Tue Jun 7 13:24:28 2022] DELETE /compute/v2.1/os-volumes/d202f1c5-19c0-47f9-96bb-08e62f257666 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:24:28.399066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a8e5e5b7-fffd-4fca-91b3-60da4edd2c46 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Calling method '.version_select at 0x7fb8e79c4430>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:28.409890 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a9855f9b-d98f-46c7-9cda-75c3e095d63f tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:28.410418 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a9855f9b-d98f-46c7-9cda-75c3e095d63f tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:28.417332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a9855f9b-d98f-46c7-9cda-75c3e095d63f tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:28.417790 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a9855f9b-d98f-46c7-9cda-75c3e095d63f tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:28.418812 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a9855f9b-d98f-46c7-9cda-75c3e095d63f tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:28.419250 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a9855f9b-d98f-46c7-9cda-75c3e095d63f tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:28.429711 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-a8e5e5b7-fffd-4fca-91b3-60da4edd2c46 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] HTTP exception thrown: Volume d93bc2fa-e4e9-4032-8c85-9c90991766e4 could not be found. Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a8e5e5b7-fffd-4fca-91b3-60da4edd2c46 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Request method failure captured: Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/os-volumes/d93bc2fa-e4e9-4032-8c85-9c90991766e4 HTTP/1.1 Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin1GMDU-ZgSawvbx0d3dqAp8sU3433BokfL91CgMgMI3QmXIhjeiTE7Dw006AAuLPSiwJx9aSqDOQJYpFQ3qUGlM-NvJ16gTfV1geTCt7tOdbhy_LppQeDwNyH3o4q5WyOn_KNmsOvyHet3PLfJl3XZr-tijtgAlRdbmDgZ-0R4KKBl8 Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: cf9bf7e3024d48ccaaabc5ec4e56b3c0 Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:24:28.432118 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:24:28.434044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cf9bf7e3024d48ccaaabc5ec4e56b3c0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf9bf7e3024d48ccaaabc5ec4e56b3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:24:28.434044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.434044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: cf9bf7e3024d48ccaaabc5ec4e56b3c0 Jun 07 13:24:28.434044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-VolumesNegativeTest-125473673 Jun 07 13:24:28.434044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-VolumesNegativeTest-125473673-project Jun 07 13:24:28.434044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:24:28.434044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:24:28.434044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 040ee92f471b409baa8a8a01dd0ddda4 Jun 07 13:24:28.434044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-VolumesNegativeTest-125473673-project Jun 07 13:24:28.434044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: Jun 07 13:24:28.434044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Volume d93bc2fa-e4e9-4032-8c85-9c90991766e4 could not be found. Jun 07 13:24:28.434044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': 'd93bc2fa-e4e9-4032-8c85-9c90991766e4'} Jun 07 13:24:28.434044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d93bc2fa-e4e9-4032-8c85-9c90991766e4 could not be found. (HTTP 404) (Request-ID: req-55ac8f0d-a900-4c0f-99b5-758dd3a5442c) Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:28.435141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:24:28.436537 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d93bc2fa-e4e9-4032-8c85-9c90991766e4 could not be found. Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 13:24:28.437941 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:24:28.439370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d93bc2fa-e4e9-4032-8c85-9c90991766e4 could not be found. Jun 07 13:24:28.439370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.439370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:28.439370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.439370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:28.439370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:28.439370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:28.439370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:24:28.439370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:24:28.439370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d93bc2fa-e4e9-4032-8c85-9c90991766e4 could not be found. Jun 07 13:24:28.439370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:24:28.439370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a8e5e5b7-fffd-4fca-91b3-60da4edd2c46 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] Returning 404 to user: Volume d93bc2fa-e4e9-4032-8c85-9c90991766e4 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:24:28.439370 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a8e5e5b7-fffd-4fca-91b3-60da4edd2c46 tempest-VolumesNegativeTest-125473673 tempest-VolumesNegativeTest-125473673-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/d93bc2fa-e4e9-4032-8c85-9c90991766e4" status: 404 len: 109 microversion: 2.1 time: 0.038369 Jun 07 13:24:28.446690 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 589/1179] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:24:28 2022] GET /compute/v2.1/os-volumes/d93bc2fa-e4e9-4032-8c85-9c90991766e4 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:24:28.564730 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a9855f9b-d98f-46c7-9cda-75c3e095d63f tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:28.572708 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a9855f9b-d98f-46c7-9cda-75c3e095d63f tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1318 microversion: 2.1 time: 0.167621 Jun 07 13:24:28.573304 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 591/1180] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:28 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:24:29.590280 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-60dcc9db-b134-4baa-a8b1-341e361041f8 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:29.590919 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-60dcc9db-b134-4baa-a8b1-341e361041f8 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:29.598402 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-60dcc9db-b134-4baa-a8b1-341e361041f8 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:29.599106 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-60dcc9db-b134-4baa-a8b1-341e361041f8 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:29.599871 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-60dcc9db-b134-4baa-a8b1-341e361041f8 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:29.600318 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-60dcc9db-b134-4baa-a8b1-341e361041f8 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:29.732880 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-60dcc9db-b134-4baa-a8b1-341e361041f8 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:29.740607 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-60dcc9db-b134-4baa-a8b1-341e361041f8 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1318 microversion: 2.1 time: 0.155342 Jun 07 13:24:29.741167 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 590/1181] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:29 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:30.498190 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-9fa21144-eaab-459b-91b7-9f1ddb43e77f req-7eedf8bb-ad1d-492f-a6d7-f319ff8bdedf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e65356-8724-4b15-8c81-ef58fc603b84", "name": "network-vif-plugged", "status": "completed", "tag": "3c9bb8c5-a933-4801-9cf5-e8a2eba38d2d"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:30.504468 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:30.505656 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:30.512313 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-9fa21144-eaab-459b-91b7-9f1ddb43e77f req-7eedf8bb-ad1d-492f-a6d7-f319ff8bdedf service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:30.513134 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-9fa21144-eaab-459b-91b7-9f1ddb43e77f req-7eedf8bb-ad1d-492f-a6d7-f319ff8bdedf service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:30.528235 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-9fa21144-eaab-459b-91b7-9f1ddb43e77f req-7eedf8bb-ad1d-492f-a6d7-f319ff8bdedf service nova] Creating event network-vif-plugged:3c9bb8c5-a933-4801-9cf5-e8a2eba38d2d for instance a1e65356-8724-4b15-8c81-ef58fc603b84 on hv-cinder-84496 Jun 07 13:24:30.533274 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-9fa21144-eaab-459b-91b7-9f1ddb43e77f req-7eedf8bb-ad1d-492f-a6d7-f319ff8bdedf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039427 Jun 07 13:24:30.534801 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 592/1182] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:24:30.757536 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f6e9070b-8479-4107-9bfe-8f99eebe601b tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:30.758153 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f6e9070b-8479-4107-9bfe-8f99eebe601b tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:30.760048 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=2 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:30.765928 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f6e9070b-8479-4107-9bfe-8f99eebe601b tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:30.766381 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f6e9070b-8479-4107-9bfe-8f99eebe601b tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:30.767290 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f6e9070b-8479-4107-9bfe-8f99eebe601b tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:30.767733 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f6e9070b-8479-4107-9bfe-8f99eebe601b tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:30.902609 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f6e9070b-8479-4107-9bfe-8f99eebe601b tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:30.911153 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f6e9070b-8479-4107-9bfe-8f99eebe601b tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1318 microversion: 2.1 time: 0.158058 Jun 07 13:24:30.911950 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 591/1183] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:30 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:31.928711 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0dbc0da7-4ac1-4547-9e3d-8265c7a31fc0 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:31.929413 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0dbc0da7-4ac1-4547-9e3d-8265c7a31fc0 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:31.936212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0dbc0da7-4ac1-4547-9e3d-8265c7a31fc0 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:31.936851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0dbc0da7-4ac1-4547-9e3d-8265c7a31fc0 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:31.937644 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0dbc0da7-4ac1-4547-9e3d-8265c7a31fc0 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:31.938076 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0dbc0da7-4ac1-4547-9e3d-8265c7a31fc0 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:32.071085 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0dbc0da7-4ac1-4547-9e3d-8265c7a31fc0 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:32.079370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0dbc0da7-4ac1-4547-9e3d-8265c7a31fc0 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1318 microversion: 2.1 time: 0.155794 Jun 07 13:24:32.079943 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 593/1184] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:31 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:33.096252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a1bf9b7d-ebe8-44e5-bf99-4f04da03557d tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:33.096625 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a1bf9b7d-ebe8-44e5-bf99-4f04da03557d tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:33.102740 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a1bf9b7d-ebe8-44e5-bf99-4f04da03557d tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:33.103190 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a1bf9b7d-ebe8-44e5-bf99-4f04da03557d tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:33.103959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a1bf9b7d-ebe8-44e5-bf99-4f04da03557d tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:33.104397 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a1bf9b7d-ebe8-44e5-bf99-4f04da03557d tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:33.240509 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a1bf9b7d-ebe8-44e5-bf99-4f04da03557d tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:33.250581 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a1bf9b7d-ebe8-44e5-bf99-4f04da03557d tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1507 microversion: 2.1 time: 0.155950 Jun 07 13:24:33.250581 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 592/1185] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:33 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:33.264534 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-db347d52-fb4a-4bc6-815a-ccacfa7ab506 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd37b6d1-811b-4df0-8fff-b68daa202bf2", "device": "/dev/sdb"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:33.265630 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-db347d52-fb4a-4bc6-815a-ccacfa7ab506 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:33.268097 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:33.273583 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-db347d52-fb4a-4bc6-815a-ccacfa7ab506 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:33.274207 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-db347d52-fb4a-4bc6-815a-ccacfa7ab506 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:33.275169 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-db347d52-fb4a-4bc6-815a-ccacfa7ab506 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:33.275715 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-db347d52-fb4a-4bc6-815a-ccacfa7ab506 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:33.533383 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-db347d52-fb4a-4bc6-815a-ccacfa7ab506 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "POST /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272630 Jun 07 13:24:33.534067 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 594/1186] 10.222.0.58 () {60 vars in 1322 bytes} [Tue Jun 7 13:24:33 2022] POST /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:39.972835 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3dcabda0-787b-426b-b7d8-5f260a919e45 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:39.973303 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3dcabda0-787b-426b-b7d8-5f260a919e45 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:39.980580 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3dcabda0-787b-426b-b7d8-5f260a919e45 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:39.981154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3dcabda0-787b-426b-b7d8-5f260a919e45 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:39.981911 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3dcabda0-787b-426b-b7d8-5f260a919e45 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:39.982338 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3dcabda0-787b-426b-b7d8-5f260a919e45 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:40.007193 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3dcabda0-787b-426b-b7d8-5f260a919e45 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b/ips" status: 200 len: 149 microversion: 2.1 time: 0.245302 Jun 07 13:24:40.007748 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 593/1187] 10.222.0.58 () {58 vars in 1247 bytes} [Tue Jun 7 13:24:39 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b/ips => generated 149 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:41.362305 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f29ce4de-6579-4c28-abc3-8f8c5212731a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "245625a9-91ef-45d0-bbdc-bd039c2454a8"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:41.364212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f29ce4de-6579-4c28-abc3-8f8c5212731a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:41.370987 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f29ce4de-6579-4c28-abc3-8f8c5212731a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:41.371441 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f29ce4de-6579-4c28-abc3-8f8c5212731a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:41.372323 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f29ce4de-6579-4c28-abc3-8f8c5212731a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:41.372773 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f29ce4de-6579-4c28-abc3-8f8c5212731a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:41.637870 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f29ce4de-6579-4c28-abc3-8f8c5212731a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "POST /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281089 Jun 07 13:24:41.638529 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 595/1188] 10.222.0.58 () {60 vars in 1322 bytes} [Tue Jun 7 13:24:41 2022] POST /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:55.999241 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-556ec18e-b50b-4cc9-a608-35f6eaf716fe tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:55.999761 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-556ec18e-b50b-4cc9-a608-35f6eaf716fe tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:56.002178 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:56.002975 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=54 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:56.009823 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-556ec18e-b50b-4cc9-a608-35f6eaf716fe tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:56.010274 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-556ec18e-b50b-4cc9-a608-35f6eaf716fe tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:56.011069 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-556ec18e-b50b-4cc9-a608-35f6eaf716fe tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:56.011509 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-556ec18e-b50b-4cc9-a608-35f6eaf716fe tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:56.088800 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-556ec18e-b50b-4cc9-a608-35f6eaf716fe tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lazy-loading 'services' on Instance uuid a1e65356-8724-4b15-8c81-ef58fc603b84 {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:24:56.165462 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-556ec18e-b50b-4cc9-a608-35f6eaf716fe tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84/os-volume_attachments/cd37b6d1-811b-4df0-8fff-b68daa202bf2" status: 202 len: 0 microversion: 2.1 time: 0.170006 Jun 07 13:24:56.166131 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 594/1189] 10.222.0.58 () {58 vars in 1415 bytes} [Tue Jun 7 13:24:55 2022] DELETE /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84/os-volume_attachments/cd37b6d1-811b-4df0-8fff-b68daa202bf2 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:25:00.104834 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:00.107063 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:00.116181 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-406e5011-ba72-41b4-b8c0-b0bc5d68786b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:00.117801 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-406e5011-ba72-41b4-b8c0-b0bc5d68786b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:00.125414 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-406e5011-ba72-41b4-b8c0-b0bc5d68786b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:00.126109 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-406e5011-ba72-41b4-b8c0-b0bc5d68786b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:00.126975 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-406e5011-ba72-41b4-b8c0-b0bc5d68786b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:00.127476 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-406e5011-ba72-41b4-b8c0-b0bc5d68786b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:00.211204 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-406e5011-ba72-41b4-b8c0-b0bc5d68786b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lazy-loading 'services' on Instance uuid a922d01f-0f88-45e9-a764-84e36becc80b {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:25:00.390370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-406e5011-ba72-41b4-b8c0-b0bc5d68786b tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b/os-volume_attachments/245625a9-91ef-45d0-bbdc-bd039c2454a8" status: 202 len: 0 microversion: 2.1 time: 0.286842 Jun 07 13:25:00.390999 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 596/1190] 10.222.0.58 () {58 vars in 1415 bytes} [Tue Jun 7 13:25:00 2022] DELETE /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b/os-volume_attachments/245625a9-91ef-45d0-bbdc-bd039c2454a8 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:25:00.404531 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-019809e8-2bef-4347-bf40-3161e7b608bf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:00.405511 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-019809e8-2bef-4347-bf40-3161e7b608bf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:00.413938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-019809e8-2bef-4347-bf40-3161e7b608bf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:00.414389 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-019809e8-2bef-4347-bf40-3161e7b608bf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:00.415186 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-019809e8-2bef-4347-bf40-3161e7b608bf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:00.415624 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-019809e8-2bef-4347-bf40-3161e7b608bf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:00.460098 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5c048834-360a-42cc-90ec-0c029eb95982 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:00.460584 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5c048834-360a-42cc-90ec-0c029eb95982 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:00.463415 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-019809e8-2bef-4347-bf40-3161e7b608bf tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067906 Jun 07 13:25:00.464525 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 595/1191] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:25:00 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:00.467573 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5c048834-360a-42cc-90ec-0c029eb95982 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:00.468263 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5c048834-360a-42cc-90ec-0c029eb95982 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:00.469683 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5c048834-360a-42cc-90ec-0c029eb95982 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:00.470584 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5c048834-360a-42cc-90ec-0c029eb95982 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:00.497101 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5c048834-360a-42cc-90ec-0c029eb95982 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:25:00.585146 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5c048834-360a-42cc-90ec-0c029eb95982 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 204 len: 0 microversion: 2.1 time: 0.128671 Jun 07 13:25:00.585940 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 597/1192] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:25:00 2022] DELETE /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 13:25:00.594072 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c0f88538-9573-44e8-8a2d-b2058ac544a1 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:00.594712 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c0f88538-9573-44e8-8a2d-b2058ac544a1 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:00.600865 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c0f88538-9573-44e8-8a2d-b2058ac544a1 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:00.601339 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c0f88538-9573-44e8-8a2d-b2058ac544a1 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:00.602089 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c0f88538-9573-44e8-8a2d-b2058ac544a1 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:00.602556 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c0f88538-9573-44e8-8a2d-b2058ac544a1 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:00.740047 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c0f88538-9573-44e8-8a2d-b2058ac544a1 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:00.748563 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c0f88538-9573-44e8-8a2d-b2058ac544a1 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1513 microversion: 2.1 time: 0.158268 Jun 07 13:25:00.749152 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 596/1193] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:00 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:01.477144 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-56dc3564-a29a-426d-ac06-3496c8b1f0a5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:01.478171 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-56dc3564-a29a-426d-ac06-3496c8b1f0a5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:01.486226 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-56dc3564-a29a-426d-ac06-3496c8b1f0a5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:01.486888 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-56dc3564-a29a-426d-ac06-3496c8b1f0a5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:01.488566 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-56dc3564-a29a-426d-ac06-3496c8b1f0a5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:01.489334 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-56dc3564-a29a-426d-ac06-3496c8b1f0a5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:01.523079 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-56dc3564-a29a-426d-ac06-3496c8b1f0a5 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050378 Jun 07 13:25:01.523680 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 598/1194] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:25:01 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:01.765623 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a13ba908-efc4-4d7b-a094-d21b3553f5ee tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:01.766314 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a13ba908-efc4-4d7b-a094-d21b3553f5ee tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:01.773025 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a13ba908-efc4-4d7b-a094-d21b3553f5ee tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:01.773473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a13ba908-efc4-4d7b-a094-d21b3553f5ee tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:01.774237 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a13ba908-efc4-4d7b-a094-d21b3553f5ee tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:01.774707 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a13ba908-efc4-4d7b-a094-d21b3553f5ee tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:01.912381 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a13ba908-efc4-4d7b-a094-d21b3553f5ee tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:01.919843 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a13ba908-efc4-4d7b-a094-d21b3553f5ee tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1513 microversion: 2.1 time: 0.158297 Jun 07 13:25:01.920416 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 597/1195] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:01 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:02.535236 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d75afce7-21be-4cb9-ad11-5eb0a04d3264 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:02.536210 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d75afce7-21be-4cb9-ad11-5eb0a04d3264 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:02.543181 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d75afce7-21be-4cb9-ad11-5eb0a04d3264 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:02.543630 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d75afce7-21be-4cb9-ad11-5eb0a04d3264 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:02.544399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d75afce7-21be-4cb9-ad11-5eb0a04d3264 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:02.544886 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d75afce7-21be-4cb9-ad11-5eb0a04d3264 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:02.573511 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d75afce7-21be-4cb9-ad11-5eb0a04d3264 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042234 Jun 07 13:25:02.574153 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 599/1196] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:25:02 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:02.936698 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9943fe94-4a41-4bfe-9b76-13ab965a56c8 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:02.937565 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9943fe94-4a41-4bfe-9b76-13ab965a56c8 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:02.944481 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9943fe94-4a41-4bfe-9b76-13ab965a56c8 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:02.944762 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9943fe94-4a41-4bfe-9b76-13ab965a56c8 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:02.945518 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9943fe94-4a41-4bfe-9b76-13ab965a56c8 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:02.945946 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9943fe94-4a41-4bfe-9b76-13ab965a56c8 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:03.097849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9943fe94-4a41-4bfe-9b76-13ab965a56c8 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:03.106296 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9943fe94-4a41-4bfe-9b76-13ab965a56c8 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1513 microversion: 2.1 time: 0.173136 Jun 07 13:25:03.107194 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 598/1197] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:02 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:03.585258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-610ede3a-827a-4130-a0af-6ab384534f98 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:03.586325 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-610ede3a-827a-4130-a0af-6ab384534f98 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:03.593048 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-610ede3a-827a-4130-a0af-6ab384534f98 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:03.593730 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-610ede3a-827a-4130-a0af-6ab384534f98 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:03.594605 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-610ede3a-827a-4130-a0af-6ab384534f98 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:03.595211 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-610ede3a-827a-4130-a0af-6ab384534f98 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:03.626650 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-610ede3a-827a-4130-a0af-6ab384534f98 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045214 Jun 07 13:25:03.627223 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 599/1198] 10.222.0.58 () {58 vars in 1301 bytes} [Tue Jun 7 13:25:03 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 13:25:03.650813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-ccaa11bd-9f2b-471b-b631-068a0e56d848 req-a281d1dc-3783-4488-9cbc-df70f010e4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e65356-8724-4b15-8c81-ef58fc603b84", "name": "network-vif-deleted", "tag": "3c9bb8c5-a933-4801-9cf5-e8a2eba38d2d"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:25:03.659270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-ccaa11bd-9f2b-471b-b631-068a0e56d848 req-a281d1dc-3783-4488-9cbc-df70f010e4b2 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:03.659742 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-ccaa11bd-9f2b-471b-b631-068a0e56d848 req-a281d1dc-3783-4488-9cbc-df70f010e4b2 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:03.671089 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-ccaa11bd-9f2b-471b-b631-068a0e56d848 req-a281d1dc-3783-4488-9cbc-df70f010e4b2 service nova] Creating event network-vif-deleted:3c9bb8c5-a933-4801-9cf5-e8a2eba38d2d for instance a1e65356-8724-4b15-8c81-ef58fc603b84 on hv-cinder-84496 Jun 07 13:25:03.676064 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-ccaa11bd-9f2b-471b-b631-068a0e56d848 req-a281d1dc-3783-4488-9cbc-df70f010e4b2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205989 Jun 07 13:25:03.676643 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 600/1199] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:03.686834 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-93152324-a0e6-451f-bd26-6ea445397a32 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:03.687335 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-93152324-a0e6-451f-bd26-6ea445397a32 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:03.693400 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-93152324-a0e6-451f-bd26-6ea445397a32 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:03.693847 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-93152324-a0e6-451f-bd26-6ea445397a32 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:03.694680 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-93152324-a0e6-451f-bd26-6ea445397a32 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:03.695112 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-93152324-a0e6-451f-bd26-6ea445397a32 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:03.718940 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-93152324-a0e6-451f-bd26-6ea445397a32 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Going to try to terminate instance {{(pid=117797) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:25:03.790873 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-93152324-a0e6-451f-bd26-6ea445397a32 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 204 len: 0 microversion: 2.1 time: 0.107545 Jun 07 13:25:03.791403 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 600/1200] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:25:03 2022] DELETE /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:25:03.799909 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2acdc50e-5354-4401-a811-538794184a97 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:03.800605 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2acdc50e-5354-4401-a811-538794184a97 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:03.806772 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2acdc50e-5354-4401-a811-538794184a97 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:03.807212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2acdc50e-5354-4401-a811-538794184a97 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:03.807961 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2acdc50e-5354-4401-a811-538794184a97 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:03.808389 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2acdc50e-5354-4401-a811-538794184a97 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:03.936714 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2acdc50e-5354-4401-a811-538794184a97 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:03.944430 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2acdc50e-5354-4401-a811-538794184a97 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1681 microversion: 2.1 time: 0.148731 Jun 07 13:25:03.944996 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 601/1201] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:03 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:04.124805 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a8f1d8b0-3584-40c5-be21-f495a9b46650 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:04.125510 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a8f1d8b0-3584-40c5-be21-f495a9b46650 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:04.131916 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a8f1d8b0-3584-40c5-be21-f495a9b46650 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:04.132368 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a8f1d8b0-3584-40c5-be21-f495a9b46650 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:04.133198 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a8f1d8b0-3584-40c5-be21-f495a9b46650 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:04.133638 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a8f1d8b0-3584-40c5-be21-f495a9b46650 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:04.165953 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a8f1d8b0-3584-40c5-be21-f495a9b46650 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:04.166404 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a8f1d8b0-3584-40c5-be21-f495a9b46650 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:04.166878 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-a8f1d8b0-3584-40c5-be21-f495a9b46650 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lazy-loading 'fault' on Instance uuid a1e65356-8724-4b15-8c81-ef58fc603b84 {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:25:04.206477 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a8f1d8b0-3584-40c5-be21-f495a9b46650 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:04.214406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a8f1d8b0-3584-40c5-be21-f495a9b46650 tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1308 microversion: 2.1 time: 0.093843 Jun 07 13:25:04.214985 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 601/1202] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:04 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:04.962911 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b5fcfc3f-2779-47f6-880c-b358fcf40525 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:04.963580 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b5fcfc3f-2779-47f6-880c-b358fcf40525 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:04.970256 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b5fcfc3f-2779-47f6-880c-b358fcf40525 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:04.970741 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b5fcfc3f-2779-47f6-880c-b358fcf40525 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:04.971506 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b5fcfc3f-2779-47f6-880c-b358fcf40525 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:04.971939 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b5fcfc3f-2779-47f6-880c-b358fcf40525 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:05.112816 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b5fcfc3f-2779-47f6-880c-b358fcf40525 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:05.120182 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b5fcfc3f-2779-47f6-880c-b358fcf40525 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1681 microversion: 2.1 time: 0.161921 Jun 07 13:25:05.120744 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 602/1203] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:04 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:05.230877 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-17e87194-6b9e-4b7d-86b1-1ffb682c81aa tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:05.231487 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-17e87194-6b9e-4b7d-86b1-1ffb682c81aa tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:05.237891 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-17e87194-6b9e-4b7d-86b1-1ffb682c81aa tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:05.238342 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-17e87194-6b9e-4b7d-86b1-1ffb682c81aa tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:05.239126 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-17e87194-6b9e-4b7d-86b1-1ffb682c81aa tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:05.239556 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-17e87194-6b9e-4b7d-86b1-1ffb682c81aa tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:05.270633 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-17e87194-6b9e-4b7d-86b1-1ffb682c81aa tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:05.271744 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-17e87194-6b9e-4b7d-86b1-1ffb682c81aa tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:05.272187 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-17e87194-6b9e-4b7d-86b1-1ffb682c81aa tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lazy-loading 'fault' on Instance uuid a1e65356-8724-4b15-8c81-ef58fc603b84 {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:25:05.313344 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-17e87194-6b9e-4b7d-86b1-1ffb682c81aa tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2520416576534123979c732a6837a368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14800dce94ee42638e6335472a0a46a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:05.321663 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-17e87194-6b9e-4b7d-86b1-1ffb682c81aa tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 200 len: 1308 microversion: 2.1 time: 0.094986 Jun 07 13:25:05.322530 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 602/1204] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:05 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:06.138186 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3f10c1f2-1f9d-4a1d-9263-2233cabca62a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:06.139139 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3f10c1f2-1f9d-4a1d-9263-2233cabca62a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:06.145404 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3f10c1f2-1f9d-4a1d-9263-2233cabca62a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:06.145933 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3f10c1f2-1f9d-4a1d-9263-2233cabca62a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:06.146729 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3f10c1f2-1f9d-4a1d-9263-2233cabca62a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:06.147347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3f10c1f2-1f9d-4a1d-9263-2233cabca62a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:06.339423 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-bfc1fac0-3dfb-4dca-b4c8-39878cf42c1a tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:06.340900 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-bfc1fac0-3dfb-4dca-b4c8-39878cf42c1a tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] [instance: a1e65356-8724-4b15-8c81-ef58fc603b84] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:06.349232 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bfc1fac0-3dfb-4dca-b4c8-39878cf42c1a tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:06.349827 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bfc1fac0-3dfb-4dca-b4c8-39878cf42c1a tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:06.351745 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bfc1fac0-3dfb-4dca-b4c8-39878cf42c1a tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:06.352285 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-bfc1fac0-3dfb-4dca-b4c8-39878cf42c1a tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:06.368871 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-bfc1fac0-3dfb-4dca-b4c8-39878cf42c1a tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] HTTP exception thrown: Instance a1e65356-8724-4b15-8c81-ef58fc603b84 could not be found. Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-bfc1fac0-3dfb-4dca-b4c8-39878cf42c1a tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Request method failure captured: Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 HTTP/1.1 Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin1EYCnRLk_E3sLDVLgD9ngzxDmGHMEbuEQnmZE2_Z92X714OXpRJravt2fS8bqN-pgONzIF-p3UYYgBeKz7bqQLnTdPoz477WcoASWxLgBYNLsRTnGqpUHeurWnw1oN7_lYRHdUohsDK6iy7drw5yd59OcaE6_zG-rntOtW9340DR-Y Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 14800dce94ee42638e6335472a0a46a7 Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-VolumesSnapshotTestJSON-773471708 Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:25:06.370959 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:25:06.372526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14800dce94ee42638e6335472a0a46a7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14800dce94ee42638e6335472a0a46a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14800dce94ee42638e6335472a0a46a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14800dce94ee42638e6335472a0a46a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:25:06.372526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-VolumesSnapshotTestJSON-773471708 Jun 07 13:25:06.372526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 14800dce94ee42638e6335472a0a46a7 Jun 07 13:25:06.372526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-773471708 Jun 07 13:25:06.372526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-VolumesSnapshotTestJSON-773471708-project Jun 07 13:25:06.372526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:25:06.372526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:25:06.372526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 2520416576534123979c732a6837a368 Jun 07 13:25:06.372526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-VolumesSnapshotTestJSON-773471708-project Jun 07 13:25:06.372526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:25:06.372526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance a1e65356-8724-4b15-8c81-ef58fc603b84 could not be found. Jun 07 13:25:06.372526 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': 'a1e65356-8724-4b15-8c81-ef58fc603b84'} Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1e65356-8724-4b15-8c81-ef58fc603b84 could not be found. Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:06.373401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1e65356-8724-4b15-8c81-ef58fc603b84 could not be found. Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1e65356-8724-4b15-8c81-ef58fc603b84 could not be found. Jun 07 13:25:06.374949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:06.377211 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-bfc1fac0-3dfb-4dca-b4c8-39878cf42c1a tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] Returning 404 to user: Instance a1e65356-8724-4b15-8c81-ef58fc603b84 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:06.379286 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-bfc1fac0-3dfb-4dca-b4c8-39878cf42c1a tempest-VolumesSnapshotTestJSON-773471708 tempest-VolumesSnapshotTestJSON-773471708-project] 10.222.0.58 "GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84" status: 404 len: 111 microversion: 2.1 time: 0.044544 Jun 07 13:25:06.381269 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 603/1205] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:06 2022] GET /compute/v2.1/servers/a1e65356-8724-4b15-8c81-ef58fc603b84 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:06.393837 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3f10c1f2-1f9d-4a1d-9263-2233cabca62a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:06.404054 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3f10c1f2-1f9d-4a1d-9263-2233cabca62a tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1681 microversion: 2.1 time: 0.270415 Jun 07 13:25:06.414301 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 603/1206] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:06 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1681 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:06.925328 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-e682b8bb-e150-405d-848c-b9c19e3c689a req-2b5f703b-e386-4aab-af01-14658b57bb40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a922d01f-0f88-45e9-a764-84e36becc80b", "name": "network-vif-deleted", "tag": "02ca69ec-a548-40b3-8958-bfe7e017d9c2"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:25:06.940545 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-e682b8bb-e150-405d-848c-b9c19e3c689a req-2b5f703b-e386-4aab-af01-14658b57bb40 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:06.941005 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-e682b8bb-e150-405d-848c-b9c19e3c689a req-2b5f703b-e386-4aab-af01-14658b57bb40 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:06.954114 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-e682b8bb-e150-405d-848c-b9c19e3c689a req-2b5f703b-e386-4aab-af01-14658b57bb40 service nova] Creating event network-vif-deleted:02ca69ec-a548-40b3-8958-bfe7e017d9c2 for instance a922d01f-0f88-45e9-a764-84e36becc80b on hv-cinder-84496 Jun 07 13:25:06.962816 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-e682b8bb-e150-405d-848c-b9c19e3c689a req-2b5f703b-e386-4aab-af01-14658b57bb40 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045065 Jun 07 13:25:06.963693 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 604/1207] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:07.421150 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c07105f1-887a-47f1-8aa2-49e24f996b21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:07.421975 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c07105f1-887a-47f1-8aa2-49e24f996b21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:07.429118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c07105f1-887a-47f1-8aa2-49e24f996b21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:07.429574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c07105f1-887a-47f1-8aa2-49e24f996b21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:07.430707 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c07105f1-887a-47f1-8aa2-49e24f996b21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:07.431082 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c07105f1-887a-47f1-8aa2-49e24f996b21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:07.483453 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c07105f1-887a-47f1-8aa2-49e24f996b21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:07.484315 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c07105f1-887a-47f1-8aa2-49e24f996b21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:07.484989 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-c07105f1-887a-47f1-8aa2-49e24f996b21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lazy-loading 'fault' on Instance uuid a922d01f-0f88-45e9-a764-84e36becc80b {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:25:07.560183 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c07105f1-887a-47f1-8aa2-49e24f996b21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1a9bfb57f64b85b635c29090aa498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd6f908209c418490bccdbdef7691a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:07.573677 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c07105f1-887a-47f1-8aa2-49e24f996b21 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 200 len: 1331 microversion: 2.1 time: 0.156328 Jun 07 13:25:07.579620 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 604/1208] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:07 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 1331 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:07.679162 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-6d449f3a-92c6-4946-855b-57d519cbd3c3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:07.680216 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-6d449f3a-92c6-4946-855b-57d519cbd3c3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:07.686753 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6d449f3a-92c6-4946-855b-57d519cbd3c3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:07.687208 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6d449f3a-92c6-4946-855b-57d519cbd3c3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:07.688040 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6d449f3a-92c6-4946-855b-57d519cbd3c3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:07.688535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6d449f3a-92c6-4946-855b-57d519cbd3c3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:07.721176 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-6d449f3a-92c6-4946-855b-57d519cbd3c3 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048412 Jun 07 13:25:07.721918 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 605/1209] 10.222.0.58 () {60 vars in 1342 bytes} [Tue Jun 7 13:25:07 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:07.781801 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-56b1a2d8-5902-46ff-8e7a-d9ef3a732019 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:07.784396 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-56b1a2d8-5902-46ff-8e7a-d9ef3a732019 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:07.792274 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-56b1a2d8-5902-46ff-8e7a-d9ef3a732019 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:07.792903 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-56b1a2d8-5902-46ff-8e7a-d9ef3a732019 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:07.793676 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-56b1a2d8-5902-46ff-8e7a-d9ef3a732019 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:07.794271 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-56b1a2d8-5902-46ff-8e7a-d9ef3a732019 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:07.836232 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-56b1a2d8-5902-46ff-8e7a-d9ef3a732019 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:25:07.937505 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-56b1a2d8-5902-46ff-8e7a-d9ef3a732019 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 204 len: 0 microversion: 2.20 time: 0.158988 Jun 07 13:25:07.938216 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 605/1210] 10.222.0.58 () {60 vars in 1279 bytes} [Tue Jun 7 13:25:07 2022] DELETE /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 07 13:25:07.947888 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b9b8ba47-7ad6-4a87-a0f6-4e12cd3bd0bb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:07.948557 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b9b8ba47-7ad6-4a87-a0f6-4e12cd3bd0bb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:07.956620 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b9b8ba47-7ad6-4a87-a0f6-4e12cd3bd0bb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:07.957148 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b9b8ba47-7ad6-4a87-a0f6-4e12cd3bd0bb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:07.957978 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b9b8ba47-7ad6-4a87-a0f6-4e12cd3bd0bb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:07.959109 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b9b8ba47-7ad6-4a87-a0f6-4e12cd3bd0bb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:08.140744 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b9b8ba47-7ad6-4a87-a0f6-4e12cd3bd0bb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:08.149261 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b9b8ba47-7ad6-4a87-a0f6-4e12cd3bd0bb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:08.150790 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b9b8ba47-7ad6-4a87-a0f6-4e12cd3bd0bb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:08.152205 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b9b8ba47-7ad6-4a87-a0f6-4e12cd3bd0bb tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.209714 Jun 07 13:25:08.152756 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 606/1211] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:25:07 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:25:08.592340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-10cff96f-719b-4454-a7ea-22c21d4b473c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:08.593036 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-10cff96f-719b-4454-a7ea-22c21d4b473c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:08.600024 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-10cff96f-719b-4454-a7ea-22c21d4b473c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:08.600467 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-10cff96f-719b-4454-a7ea-22c21d4b473c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:08.601219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-10cff96f-719b-4454-a7ea-22c21d4b473c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:08.601646 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-10cff96f-719b-4454-a7ea-22c21d4b473c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:08.615498 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-10cff96f-719b-4454-a7ea-22c21d4b473c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] HTTP exception thrown: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-10cff96f-719b-4454-a7ea-22c21d4b473c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Request method failure captured: Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b HTTP/1.1 Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08U-o1RXkpPvRpL7xDzNFmHnSj255NFDhEpduNc0925DPg27io8CB6KRvQZuxcGtY7Iz0iEoMVidEoHUACL1lIGmUyRUR_8aMLzRLJXAMtSSy6JOQkiG83CLgwqXPfpWRfIbnqNAok3xO_9QFcJIn-p7dfSyPkb5TLmEFYuzTkAq94 Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:25:08.617265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:25:08.619124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd6f908209c418490bccdbdef7691a5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:25:08.619124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:08.619124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:08.619124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:08.619124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:08.619124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:25:08.619124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:25:08.619124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 3f1a9bfb57f64b85b635c29090aa498c Jun 07 13:25:08.619124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:08.619124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:25:08.619124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. Jun 07 13:25:08.619124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': 'a922d01f-0f88-45e9-a764-84e36becc80b'} Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:08.620332 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. Jun 07 13:25:08.621813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:08.623194 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-10cff96f-719b-4454-a7ea-22c21d4b473c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Returning 404 to user: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:08.623194 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-10cff96f-719b-4454-a7ea-22c21d4b473c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 404 len: 111 microversion: 2.1 time: 0.030501 Jun 07 13:25:08.623194 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 606/1212] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:08 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:08.628102 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-626aa178-49e3-4068-aaea-79f7b2109780 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '.version_select at 0x7fb8e79ad3a0>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:08.645065 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-626aa178-49e3-4068-aaea-79f7b2109780 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899470818" status: 202 len: 0 microversion: 2.1 time: 0.020798 Jun 07 13:25:08.646369 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 607/1213] 10.222.0.58 () {58 vars in 1220 bytes} [Tue Jun 7 13:25:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899470818 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:25:09.174234 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6cf05245-f1ca-4791-889f-14558d9319b6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:09.174791 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6cf05245-f1ca-4791-889f-14558d9319b6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:09.181492 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6cf05245-f1ca-4791-889f-14558d9319b6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:09.181949 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6cf05245-f1ca-4791-889f-14558d9319b6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:09.182742 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6cf05245-f1ca-4791-889f-14558d9319b6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:09.183184 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6cf05245-f1ca-4791-889f-14558d9319b6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:09.320897 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6cf05245-f1ca-4791-889f-14558d9319b6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:09.328908 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6cf05245-f1ca-4791-889f-14558d9319b6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:09.330474 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6cf05245-f1ca-4791-889f-14558d9319b6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:09.331629 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6cf05245-f1ca-4791-889f-14558d9319b6 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.161603 Jun 07 13:25:09.332181 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 607/1214] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:25:09 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:25:10.350146 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5d54a3cf-ca8e-4c54-8e37-d3a71d7b2e5c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:10.350730 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5d54a3cf-ca8e-4c54-8e37-d3a71d7b2e5c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:10.356684 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5d54a3cf-ca8e-4c54-8e37-d3a71d7b2e5c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:10.357132 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5d54a3cf-ca8e-4c54-8e37-d3a71d7b2e5c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:10.357886 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5d54a3cf-ca8e-4c54-8e37-d3a71d7b2e5c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:10.358325 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5d54a3cf-ca8e-4c54-8e37-d3a71d7b2e5c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:10.483020 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5d54a3cf-ca8e-4c54-8e37-d3a71d7b2e5c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:10.490928 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5d54a3cf-ca8e-4c54-8e37-d3a71d7b2e5c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:10.492445 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5d54a3cf-ca8e-4c54-8e37-d3a71d7b2e5c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:10.493597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5d54a3cf-ca8e-4c54-8e37-d3a71d7b2e5c tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.148009 Jun 07 13:25:10.494194 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 608/1215] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:25:10 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:25:11.512112 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3c3afc34-7e9b-4887-917b-0e7faec9a777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:11.512835 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3c3afc34-7e9b-4887-917b-0e7faec9a777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:11.519460 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c3afc34-7e9b-4887-917b-0e7faec9a777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:11.519910 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c3afc34-7e9b-4887-917b-0e7faec9a777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:11.520663 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c3afc34-7e9b-4887-917b-0e7faec9a777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:11.521096 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3c3afc34-7e9b-4887-917b-0e7faec9a777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:11.655274 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3c3afc34-7e9b-4887-917b-0e7faec9a777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:11.663608 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3c3afc34-7e9b-4887-917b-0e7faec9a777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:11.665109 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3c3afc34-7e9b-4887-917b-0e7faec9a777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:11.666296 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3c3afc34-7e9b-4887-917b-0e7faec9a777 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.158005 Jun 07 13:25:11.666835 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 608/1216] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:25:11 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:25:12.685130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b7b275cd-e9e0-44e2-8cad-edb408e75f0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:12.685766 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b7b275cd-e9e0-44e2-8cad-edb408e75f0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:12.692260 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b7b275cd-e9e0-44e2-8cad-edb408e75f0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:12.692709 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b7b275cd-e9e0-44e2-8cad-edb408e75f0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:12.693464 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b7b275cd-e9e0-44e2-8cad-edb408e75f0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:12.693935 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b7b275cd-e9e0-44e2-8cad-edb408e75f0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:12.822768 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b7b275cd-e9e0-44e2-8cad-edb408e75f0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:12.826591 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:12.836547 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b7b275cd-e9e0-44e2-8cad-edb408e75f0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:12.838150 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b7b275cd-e9e0-44e2-8cad-edb408e75f0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:12.839476 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b7b275cd-e9e0-44e2-8cad-edb408e75f0f tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1723 microversion: 2.20 time: 0.158201 Jun 07 13:25:12.840207 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 609/1217] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:25:12 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:25:13.554050 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-63a10798-94cb-4734-b82e-da1cee0abd7c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:13.555090 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-63a10798-94cb-4734-b82e-da1cee0abd7c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:13.561279 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-63a10798-94cb-4734-b82e-da1cee0abd7c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:13.561959 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-63a10798-94cb-4734-b82e-da1cee0abd7c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:13.562769 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-63a10798-94cb-4734-b82e-da1cee0abd7c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:13.563371 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-63a10798-94cb-4734-b82e-da1cee0abd7c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:13.579840 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-63a10798-94cb-4734-b82e-da1cee0abd7c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] HTTP exception thrown: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-63a10798-94cb-4734-b82e-da1cee0abd7c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Request method failure captured: Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: DELETE /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b HTTP/1.1 Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08U-o1RXkpPvRpL7xDzNFmHnSj255NFDhEpduNc0925DPg27io8CB6KRvQZuxcGtY7Iz0iEoMVidEoHUACL1lIGmUyRUR_8aMLzRLJXAMtSSy6JOQkiG83CLgwqXPfpWRfIbnqNAok3xO_9QFcJIn-p7dfSyPkb5TLmEFYuzTkAq94 Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:25:13.581463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:25:13.583118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd6f908209c418490bccdbdef7691a5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:25:13.583118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:13.583118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:13.583118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:13.583118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:13.583118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:25:13.583118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:25:13.583118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 3f1a9bfb57f64b85b635c29090aa498c Jun 07 13:25:13.583118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:13.583118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:25:13.583118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. Jun 07 13:25:13.583118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': 'a922d01f-0f88-45e9-a764-84e36becc80b'} Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:13.584507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. Jun 07 13:25:13.586206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.588564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-63a10798-94cb-4734-b82e-da1cee0abd7c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Returning 404 to user: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:13.588564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-63a10798-94cb-4734-b82e-da1cee0abd7c tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 404 len: 111 microversion: 2.1 time: 0.034467 Jun 07 13:25:13.588564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 609/1218] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:25:13 2022] DELETE /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:13.592726 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-013619e0-b639-47a5-84e6-953cef3a3a00 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:13.593340 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-013619e0-b639-47a5-84e6-953cef3a3a00 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: a922d01f-0f88-45e9-a764-84e36becc80b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:13.601244 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-013619e0-b639-47a5-84e6-953cef3a3a00 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:13.601732 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-013619e0-b639-47a5-84e6-953cef3a3a00 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:13.602809 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-013619e0-b639-47a5-84e6-953cef3a3a00 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:13.603405 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-013619e0-b639-47a5-84e6-953cef3a3a00 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:13.620569 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-013619e0-b639-47a5-84e6-953cef3a3a00 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] HTTP exception thrown: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-013619e0-b639-47a5-84e6-953cef3a3a00 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Request method failure captured: Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b HTTP/1.1 Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08U-o1RXkpPvRpL7xDzNFmHnSj255NFDhEpduNc0925DPg27io8CB6KRvQZuxcGtY7Iz0iEoMVidEoHUACL1lIGmUyRUR_8aMLzRLJXAMtSSy6JOQkiG83CLgwqXPfpWRfIbnqNAok3xO_9QFcJIn-p7dfSyPkb5TLmEFYuzTkAq94 Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:25:13.622595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:25:13.624188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd6f908209c418490bccdbdef7691a5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:25:13.624188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:13.624188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:13.624188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:13.624188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:13.624188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:25:13.624188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:25:13.624188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 3f1a9bfb57f64b85b635c29090aa498c Jun 07 13:25:13.624188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:13.624188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:25:13.624188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. Jun 07 13:25:13.624188 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': 'a922d01f-0f88-45e9-a764-84e36becc80b'} Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:13.625060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. Jun 07 13:25:13.626560 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.627816 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-013619e0-b639-47a5-84e6-953cef3a3a00 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Returning 404 to user: Instance a922d01f-0f88-45e9-a764-84e36becc80b could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:13.627816 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-013619e0-b639-47a5-84e6-953cef3a3a00 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b" status: 404 len: 111 microversion: 2.1 time: 0.035970 Jun 07 13:25:13.627816 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 610/1219] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:13 2022] GET /compute/v2.1/servers/a922d01f-0f88-45e9-a764-84e36becc80b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:13.859052 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5540902e-a916-4774-b8a8-5dd9ec8a85f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:13.859931 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5540902e-a916-4774-b8a8-5dd9ec8a85f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:13.866766 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5540902e-a916-4774-b8a8-5dd9ec8a85f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:13.867507 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5540902e-a916-4774-b8a8-5dd9ec8a85f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:13.868370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5540902e-a916-4774-b8a8-5dd9ec8a85f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:13.868878 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5540902e-a916-4774-b8a8-5dd9ec8a85f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:13.888362 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:13.959594 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-5b3b2b79-a0a6-491c-a2a9-e99e5a02c961 req-682cefa3-003d-4c9d-8651-355a393e997f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7a49f1-361e-4684-9134-0ba52665297b", "name": "network-vif-deleted", "tag": "5cbf5f8c-af01-4a2e-8f16-dd54822bb4cd"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:25:13.969978 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-5b3b2b79-a0a6-491c-a2a9-e99e5a02c961 req-682cefa3-003d-4c9d-8651-355a393e997f service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:13.970417 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-5b3b2b79-a0a6-491c-a2a9-e99e5a02c961 req-682cefa3-003d-4c9d-8651-355a393e997f service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:13.976587 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5540902e-a916-4774-b8a8-5dd9ec8a85f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:13.989240 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-5b3b2b79-a0a6-491c-a2a9-e99e5a02c961 req-682cefa3-003d-4c9d-8651-355a393e997f service nova] Creating event network-vif-deleted:5cbf5f8c-af01-4a2e-8f16-dd54822bb4cd for instance af7a49f1-361e-4684-9134-0ba52665297b on hv-cinder-84496 Jun 07 13:25:13.993382 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5540902e-a916-4774-b8a8-5dd9ec8a85f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:13.995213 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5540902e-a916-4774-b8a8-5dd9ec8a85f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1785cda265641259d831cb0b6a6a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415de13612d47928af70862de8576be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:13.995682 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-5b3b2b79-a0a6-491c-a2a9-e99e5a02c961 req-682cefa3-003d-4c9d-8651-355a393e997f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039985 Jun 07 13:25:13.996856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 611/1220] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:13.999212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5540902e-a916-4774-b8a8-5dd9ec8a85f0 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 200 len: 1655 microversion: 2.20 time: 0.141946 Jun 07 13:25:14.000107 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 610/1221] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:25:13 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 1655 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:25:14.771544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a1b9d8aa-15d1-4817-8c81-5bc4ba584db1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:14.772127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a1b9d8aa-15d1-4817-8c81-5bc4ba584db1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:14.778751 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a1b9d8aa-15d1-4817-8c81-5bc4ba584db1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:14.779199 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a1b9d8aa-15d1-4817-8c81-5bc4ba584db1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:14.779992 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a1b9d8aa-15d1-4817-8c81-5bc4ba584db1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:14.780425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a1b9d8aa-15d1-4817-8c81-5bc4ba584db1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:14.795338 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-a1b9d8aa-15d1-4817-8c81-5bc4ba584db1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] HTTP exception thrown: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a1b9d8aa-15d1-4817-8c81-5bc4ba584db1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Request method failure captured: Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: DELETE /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc HTTP/1.1 Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08U-o1RXkpPvRpL7xDzNFmHnSj255NFDhEpduNc0925DPg27io8CB6KRvQZuxcGtY7Iz0iEoMVidEoHUACL1lIGmUyRUR_8aMLzRLJXAMtSSy6JOQkiG83CLgwqXPfpWRfIbnqNAok3xO_9QFcJIn-p7dfSyPkb5TLmEFYuzTkAq94 Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:25:14.797009 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:25:14.798673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd6f908209c418490bccdbdef7691a5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:25:14.798673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:14.798673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:14.798673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:14.798673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:14.798673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:25:14.798673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:25:14.798673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 3f1a9bfb57f64b85b635c29090aa498c Jun 07 13:25:14.798673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:14.798673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:25:14.798673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. Jun 07 13:25:14.798673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': '771de6d7-c5ac-4fe8-9706-dee8ef1564bc'} Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:14.799612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. Jun 07 13:25:14.801014 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.802291 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a1b9d8aa-15d1-4817-8c81-5bc4ba584db1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Returning 404 to user: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:14.802291 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a1b9d8aa-15d1-4817-8c81-5bc4ba584db1 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "DELETE /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 404 len: 111 microversion: 2.1 time: 0.031192 Jun 07 13:25:14.802291 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 612/1222] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:25:14 2022] DELETE /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:14.807745 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a1c37fe1-cea2-436d-86ed-db40e24bbed9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:14.808370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a1c37fe1-cea2-436d-86ed-db40e24bbed9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 771de6d7-c5ac-4fe8-9706-dee8ef1564bc] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:14.815097 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a1c37fe1-cea2-436d-86ed-db40e24bbed9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:14.815575 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a1c37fe1-cea2-436d-86ed-db40e24bbed9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:14.816338 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a1c37fe1-cea2-436d-86ed-db40e24bbed9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:14.816771 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a1c37fe1-cea2-436d-86ed-db40e24bbed9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:14.831433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-a1c37fe1-cea2-436d-86ed-db40e24bbed9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] HTTP exception thrown: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a1c37fe1-cea2-436d-86ed-db40e24bbed9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Request method failure captured: Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc HTTP/1.1 Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08U-o1RXkpPvRpL7xDzNFmHnSj255NFDhEpduNc0925DPg27io8CB6KRvQZuxcGtY7Iz0iEoMVidEoHUACL1lIGmUyRUR_8aMLzRLJXAMtSSy6JOQkiG83CLgwqXPfpWRfIbnqNAok3xO_9QFcJIn-p7dfSyPkb5TLmEFYuzTkAq94 Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:25:14.833062 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:25:14.834500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd6f908209c418490bccdbdef7691a5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:25:14.834500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:14.834500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:14.834500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:14.834500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:14.834500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:25:14.834500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:25:14.834500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 3f1a9bfb57f64b85b635c29090aa498c Jun 07 13:25:14.834500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:14.834500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:25:14.834500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. Jun 07 13:25:14.834500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': '771de6d7-c5ac-4fe8-9706-dee8ef1564bc'} Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:14.835613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. Jun 07 13:25:14.837579 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.840283 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a1c37fe1-cea2-436d-86ed-db40e24bbed9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Returning 404 to user: Instance 771de6d7-c5ac-4fe8-9706-dee8ef1564bc could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:14.840283 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a1c37fe1-cea2-436d-86ed-db40e24bbed9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc" status: 404 len: 111 microversion: 2.1 time: 0.030608 Jun 07 13:25:14.840283 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 611/1223] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:14 2022] GET /compute/v2.1/servers/771de6d7-c5ac-4fe8-9706-dee8ef1564bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:14.843134 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-caf06eb1-15d5-4f6e-99bd-a99efe39045d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:14.843637 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-caf06eb1-15d5-4f6e-99bd-a99efe39045d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:14.850467 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-caf06eb1-15d5-4f6e-99bd-a99efe39045d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:14.850969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-caf06eb1-15d5-4f6e-99bd-a99efe39045d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:14.851734 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-caf06eb1-15d5-4f6e-99bd-a99efe39045d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:14.852160 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-caf06eb1-15d5-4f6e-99bd-a99efe39045d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:14.867969 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-caf06eb1-15d5-4f6e-99bd-a99efe39045d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] HTTP exception thrown: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-caf06eb1-15d5-4f6e-99bd-a99efe39045d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Request method failure captured: Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: DELETE /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 HTTP/1.1 Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08U-o1RXkpPvRpL7xDzNFmHnSj255NFDhEpduNc0925DPg27io8CB6KRvQZuxcGtY7Iz0iEoMVidEoHUACL1lIGmUyRUR_8aMLzRLJXAMtSSy6JOQkiG83CLgwqXPfpWRfIbnqNAok3xO_9QFcJIn-p7dfSyPkb5TLmEFYuzTkAq94 Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:25:14.869468 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:25:14.870932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd6f908209c418490bccdbdef7691a5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:25:14.870932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:14.870932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:14.870932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:14.870932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:14.870932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:25:14.870932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:25:14.870932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 3f1a9bfb57f64b85b635c29090aa498c Jun 07 13:25:14.870932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:14.870932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:25:14.870932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. Jun 07 13:25:14.870932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': '4a5728ed-f056-462a-952e-ce2c4fd06b96'} Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:14.871856 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. Jun 07 13:25:14.873310 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.875195 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-caf06eb1-15d5-4f6e-99bd-a99efe39045d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Returning 404 to user: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:14.875195 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-caf06eb1-15d5-4f6e-99bd-a99efe39045d tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 404 len: 111 microversion: 2.1 time: 0.031662 Jun 07 13:25:14.875195 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 613/1224] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:25:14 2022] DELETE /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:14.879399 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fa80e82b-676b-4be2-898c-85010dd197c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:14.880042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fa80e82b-676b-4be2-898c-85010dd197c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: 4a5728ed-f056-462a-952e-ce2c4fd06b96] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:14.886023 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fa80e82b-676b-4be2-898c-85010dd197c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:14.886584 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fa80e82b-676b-4be2-898c-85010dd197c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:14.887359 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fa80e82b-676b-4be2-898c-85010dd197c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:14.887800 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fa80e82b-676b-4be2-898c-85010dd197c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:14.901305 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-fa80e82b-676b-4be2-898c-85010dd197c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] HTTP exception thrown: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fa80e82b-676b-4be2-898c-85010dd197c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Request method failure captured: Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 HTTP/1.1 Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08U-o1RXkpPvRpL7xDzNFmHnSj255NFDhEpduNc0925DPg27io8CB6KRvQZuxcGtY7Iz0iEoMVidEoHUACL1lIGmUyRUR_8aMLzRLJXAMtSSy6JOQkiG83CLgwqXPfpWRfIbnqNAok3xO_9QFcJIn-p7dfSyPkb5TLmEFYuzTkAq94 Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:25:14.902851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:25:14.904270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd6f908209c418490bccdbdef7691a5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:25:14.904270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:14.904270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:14.904270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:14.904270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:14.904270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:25:14.904270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:25:14.904270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 3f1a9bfb57f64b85b635c29090aa498c Jun 07 13:25:14.904270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:14.904270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:25:14.904270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. Jun 07 13:25:14.904270 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': '4a5728ed-f056-462a-952e-ce2c4fd06b96'} Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:14.905078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. Jun 07 13:25:14.906394 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:14.907536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fa80e82b-676b-4be2-898c-85010dd197c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Returning 404 to user: Instance 4a5728ed-f056-462a-952e-ce2c4fd06b96 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:14.907536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fa80e82b-676b-4be2-898c-85010dd197c9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96" status: 404 len: 111 microversion: 2.1 time: 0.028664 Jun 07 13:25:14.907536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 612/1225] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:14 2022] GET /compute/v2.1/servers/4a5728ed-f056-462a-952e-ce2c4fd06b96 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:25:15.019859 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-4bd217c8-674b-4780-9f4d-79759853604d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:15.021915 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-4bd217c8-674b-4780-9f4d-79759853604d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:15.028715 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4bd217c8-674b-4780-9f4d-79759853604d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:15.029469 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4bd217c8-674b-4780-9f4d-79759853604d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:15.030718 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4bd217c8-674b-4780-9f4d-79759853604d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:15.031260 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4bd217c8-674b-4780-9f4d-79759853604d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:15.045973 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-4bd217c8-674b-4780-9f4d-79759853604d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] HTTP exception thrown: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-4bd217c8-674b-4780-9f4d-79759853604d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Request method failure captured: Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b HTTP/1.1 Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08eIhtdXfyY-F6iLKNsk0VbMyGisWXTCPrvVkXrvT5fDCJuyZZcw7-T-Jncv8mPCJhGVeh-VFdBTSoFpLTmtb7RJQ_7yh9n40ks2CytmiZKVHPovMsBqOMXed6fGVqD0nYtaIzBTCdHz2DgCiEadMveyYNRYGgOlFL_JesnL_gtjAY Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 1415de13612d47928af70862de8576be Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:25:15.047586 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:25:15.049425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1415de13612d47928af70862de8576be", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1415de13612d47928af70862de8576be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1415de13612d47928af70862de8576be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1415de13612d47928af70862de8576be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:25:15.049425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:25:15.049425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 1415de13612d47928af70862de8576be Jun 07 13:25:15.049425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:25:15.049425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-AttachVolumeShelveTestJSON-1678106582-project Jun 07 13:25:15.049425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:25:15.049425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:25:15.049425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: c1785cda265641259d831cb0b6a6a34b Jun 07 13:25:15.049425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1678106582-project Jun 07 13:25:15.049425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:25:15.049425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. Jun 07 13:25:15.049425 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': 'af7a49f1-361e-4684-9134-0ba52665297b'} Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:15.050272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. Jun 07 13:25:15.051789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:15.053424 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-4bd217c8-674b-4780-9f4d-79759853604d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Returning 404 to user: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:15.053424 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-4bd217c8-674b-4780-9f4d-79759853604d tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 404 len: 111 microversion: 2.20 time: 0.033622 Jun 07 13:25:15.053424 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 614/1226] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:25:15 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:25:15.057808 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-091f5fd2-c0e5-4980-8f44-14c298011a7b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '.version_select at 0x7fb8f8f913a0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:15.061110 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR oslo.messaging._drivers.impl_rabbit [None req-091f5fd2-c0e5-4980-8f44-14c298011a7b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [f1452701-0ee4-4381-b6b4-17571e8aef92] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 13:25:16.047578 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-2a7ee9a9-ef6f-47a3-8302-16e1e40596b9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:16.048106 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-2a7ee9a9-ef6f-47a3-8302-16e1e40596b9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:16.055392 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2a7ee9a9-ef6f-47a3-8302-16e1e40596b9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:16.055967 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2a7ee9a9-ef6f-47a3-8302-16e1e40596b9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:16.056835 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2a7ee9a9-ef6f-47a3-8302-16e1e40596b9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:16.057569 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-2a7ee9a9-ef6f-47a3-8302-16e1e40596b9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:16.071327 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO oslo.messaging._drivers.impl_rabbit [None req-091f5fd2-c0e5-4980-8f44-14c298011a7b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [f1452701-0ee4-4381-b6b4-17571e8aef92] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 58988. Jun 07 13:25:16.087571 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-2a7ee9a9-ef6f-47a3-8302-16e1e40596b9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] HTTP exception thrown: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-2a7ee9a9-ef6f-47a3-8302-16e1e40596b9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Request method failure captured: Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: DELETE /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 HTTP/1.1 Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08U-o1RXkpPvRpL7xDzNFmHnSj255NFDhEpduNc0925DPg27io8CB6KRvQZuxcGtY7Iz0iEoMVidEoHUACL1lIGmUyRUR_8aMLzRLJXAMtSSy6JOQkiG83CLgwqXPfpWRfIbnqNAok3xO_9QFcJIn-p7dfSyPkb5TLmEFYuzTkAq94 Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:25:16.089473 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:25:16.091060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd6f908209c418490bccdbdef7691a5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:25:16.091060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:16.091060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:16.091060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:16.091060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:16.091060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:25:16.091060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:25:16.091060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 3f1a9bfb57f64b85b635c29090aa498c Jun 07 13:25:16.091060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:16.091060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:25:16.091060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. Jun 07 13:25:16.091060 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': 'f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0'} Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:16.091902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. Jun 07 13:25:16.093130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:16.098427 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-2a7ee9a9-ef6f-47a3-8302-16e1e40596b9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Returning 404 to user: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:16.099290 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-091f5fd2-c0e5-4980-8f44-14c298011a7b tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557192866" status: 204 len: 0 microversion: 2.20 time: 1.038674 Jun 07 13:25:16.099442 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-2a7ee9a9-ef6f-47a3-8302-16e1e40596b9 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 404 len: 111 microversion: 2.1 time: 0.050849 Jun 07 13:25:16.099540 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 613/1227] 10.222.0.58 () {60 vars in 1261 bytes} [Tue Jun 7 13:25:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557192866 => generated 0 bytes in 1040 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 13:25:16.099695 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 615/1228] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:25:16 2022] DELETE /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:16.105203 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c6539ba7-9e8b-4950-822b-575f8660ff50 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:16.111792 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c6539ba7-9e8b-4950-822b-575f8660ff50 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] [instance: f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:16.114790 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c6539ba7-9e8b-4950-822b-575f8660ff50 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:16.115927 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c6539ba7-9e8b-4950-822b-575f8660ff50 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:16.116781 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c6539ba7-9e8b-4950-822b-575f8660ff50 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:16.117292 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c6539ba7-9e8b-4950-822b-575f8660ff50 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:16.135386 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-c6539ba7-9e8b-4950-822b-575f8660ff50 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] HTTP exception thrown: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c6539ba7-9e8b-4950-822b-575f8660ff50 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Request method failure captured: Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 HTTP/1.1 Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08U-o1RXkpPvRpL7xDzNFmHnSj255NFDhEpduNc0925DPg27io8CB6KRvQZuxcGtY7Iz0iEoMVidEoHUACL1lIGmUyRUR_8aMLzRLJXAMtSSy6JOQkiG83CLgwqXPfpWRfIbnqNAok3xO_9QFcJIn-p7dfSyPkb5TLmEFYuzTkAq94 Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:25:16.137131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:25:16.138480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd6f908209c418490bccdbdef7691a5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd6f908209c418490bccdbdef7691a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:25:16.138480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:16.138480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 3fd6f908209c418490bccdbdef7691a5 Jun 07 13:25:16.138480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1135326812 Jun 07 13:25:16.138480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:16.138480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:25:16.138480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:25:16.138480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 3f1a9bfb57f64b85b635c29090aa498c Jun 07 13:25:16.138480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeNegativeTest-1135326812-project Jun 07 13:25:16.138480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:25:16.138480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. Jun 07 13:25:16.138480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': 'f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0'} Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:16.139311 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. Jun 07 13:25:16.140574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:16.141709 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c6539ba7-9e8b-4950-822b-575f8660ff50 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] Returning 404 to user: Instance f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:16.141709 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c6539ba7-9e8b-4950-822b-575f8660ff50 tempest-AttachVolumeNegativeTest-1135326812 tempest-AttachVolumeNegativeTest-1135326812-project] 10.222.0.58 "GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0" status: 404 len: 111 microversion: 2.1 time: 0.038006 Jun 07 13:25:16.143288 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 614/1229] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:16 2022] GET /compute/v2.1/servers/f162ce8d-9260-4d13-b22e-fa0ec1b6a1f0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:18.315684 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5835c33c-b809-4ed0-8e3f-46ce731473a9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:18.316849 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5835c33c-b809-4ed0-8e3f-46ce731473a9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:18.325503 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5835c33c-b809-4ed0-8e3f-46ce731473a9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:18.326410 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5835c33c-b809-4ed0-8e3f-46ce731473a9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:18.327490 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5835c33c-b809-4ed0-8e3f-46ce731473a9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:18.345604 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5835c33c-b809-4ed0-8e3f-46ce731473a9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:18.379177 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-5835c33c-b809-4ed0-8e3f-46ce731473a9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] HTTP exception thrown: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5835c33c-b809-4ed0-8e3f-46ce731473a9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Request method failure captured: Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: DELETE /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b HTTP/1.1 Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08eIhtdXfyY-F6iLKNsk0VbMyGisWXTCPrvVkXrvT5fDCJuyZZcw7-T-Jncv8mPCJhGVeh-VFdBTSoFpLTmtb7RJQ_7yh9n40ks2CytmiZKVHPovMsBqOMXed6fGVqD0nYtaIzBTCdHz2DgCiEadMveyYNRYGgOlFL_JesnL_gtjAY Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 1415de13612d47928af70862de8576be Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:25:18.382204 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:25:18.385914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1415de13612d47928af70862de8576be", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1415de13612d47928af70862de8576be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1415de13612d47928af70862de8576be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1415de13612d47928af70862de8576be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:25:18.385914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:25:18.385914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 1415de13612d47928af70862de8576be Jun 07 13:25:18.385914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:25:18.385914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-AttachVolumeShelveTestJSON-1678106582-project Jun 07 13:25:18.385914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:25:18.385914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:25:18.385914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: c1785cda265641259d831cb0b6a6a34b Jun 07 13:25:18.385914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1678106582-project Jun 07 13:25:18.385914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:25:18.385914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. Jun 07 13:25:18.385914 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': 'af7a49f1-361e-4684-9134-0ba52665297b'} Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:18.386844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. Jun 07 13:25:18.388446 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:18.395142 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5835c33c-b809-4ed0-8e3f-46ce731473a9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Returning 404 to user: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:18.397033 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5835c33c-b809-4ed0-8e3f-46ce731473a9 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 404 len: 111 microversion: 2.20 time: 0.085370 Jun 07 13:25:18.398433 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 616/1230] 10.222.0.58 () {60 vars in 1279 bytes} [Tue Jun 7 13:25:18 2022] DELETE /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:25:18.407226 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-15081680-81fd-41a1-9cef-60ede58ef0ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:18.407874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-15081680-81fd-41a1-9cef-60ede58ef0ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: af7a49f1-361e-4684-9134-0ba52665297b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:18.417761 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15081680-81fd-41a1-9cef-60ede58ef0ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:18.418231 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15081680-81fd-41a1-9cef-60ede58ef0ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:18.420568 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15081680-81fd-41a1-9cef-60ede58ef0ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:18.421189 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15081680-81fd-41a1-9cef-60ede58ef0ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:18.439832 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-15081680-81fd-41a1-9cef-60ede58ef0ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] HTTP exception thrown: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-15081680-81fd-41a1-9cef-60ede58ef0ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Request method failure captured: Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b HTTP/1.1 Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08eIhtdXfyY-F6iLKNsk0VbMyGisWXTCPrvVkXrvT5fDCJuyZZcw7-T-Jncv8mPCJhGVeh-VFdBTSoFpLTmtb7RJQ_7yh9n40ks2CytmiZKVHPovMsBqOMXed6fGVqD0nYtaIzBTCdHz2DgCiEadMveyYNRYGgOlFL_JesnL_gtjAY Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 1415de13612d47928af70862de8576be Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:25:18.442166 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:25:18.444564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1415de13612d47928af70862de8576be", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1415de13612d47928af70862de8576be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1415de13612d47928af70862de8576be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1415de13612d47928af70862de8576be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:25:18.444564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:25:18.444564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 1415de13612d47928af70862de8576be Jun 07 13:25:18.444564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:25:18.444564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeShelveTestJSON-1678106582-project Jun 07 13:25:18.444564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:25:18.444564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:25:18.444564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: c1785cda265641259d831cb0b6a6a34b Jun 07 13:25:18.444564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1678106582-project Jun 07 13:25:18.444564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:25:18.444564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. Jun 07 13:25:18.444564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': 'af7a49f1-361e-4684-9134-0ba52665297b'} Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:18.445502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. Jun 07 13:25:18.447020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:18.448357 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-15081680-81fd-41a1-9cef-60ede58ef0ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Returning 404 to user: Instance af7a49f1-361e-4684-9134-0ba52665297b could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:18.448357 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-15081680-81fd-41a1-9cef-60ede58ef0ee tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b" status: 404 len: 111 microversion: 2.20 time: 0.041847 Jun 07 13:25:18.450778 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 615/1231] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:25:18 2022] GET /compute/v2.1/servers/af7a49f1-361e-4684-9134-0ba52665297b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:25:26.541242 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-fc23e751-f231-45a2-abd1-bafb2e9f00de tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] Calling method '.version_select at 0x7fb8e7a328b0>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:26.588401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-fc23e751-f231-45a2-abd1-bafb2e9f00de tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/433543aa-c737-4e2e-8945-701db94006b1" status: 200 len: 350 microversion: 2.1 time: 0.051440 Jun 07 13:25:26.588902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 617/1232] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:25:26 2022] GET /compute/v2.1/os-volumes/433543aa-c737-4e2e-8945-701db94006b1 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:26.956336 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1cda2948-7952-46bc-9a08-bebcf7438d77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:26.957089 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1cda2948-7952-46bc-9a08-bebcf7438d77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:26.971053 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1cda2948-7952-46bc-9a08-bebcf7438d77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:26.972516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1cda2948-7952-46bc-9a08-bebcf7438d77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:26.973623 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1cda2948-7952-46bc-9a08-bebcf7438d77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:26.974379 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1cda2948-7952-46bc-9a08-bebcf7438d77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:26.990269 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-1cda2948-7952-46bc-9a08-bebcf7438d77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] HTTP exception thrown: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1cda2948-7952-46bc-9a08-bebcf7438d77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Request method failure captured: Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: DELETE /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce HTTP/1.1 Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin08eIhtdXfyY-F6iLKNsk0VbMyGisWXTCPrvVkXrvT5fDCJuyZZcw7-T-Jncv8mPCJhGVeh-VFdBTSoFpLTmtb7RJQ_7yh9n40ks2CytmiZKVHPovMsBqOMXed6fGVqD0nYtaIzBTCdHz2DgCiEadMveyYNRYGgOlFL_JesnL_gtjAY Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 1415de13612d47928af70862de8576be Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:25:26.992078 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:25:26.993891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1415de13612d47928af70862de8576be", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1415de13612d47928af70862de8576be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1415de13612d47928af70862de8576be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1415de13612d47928af70862de8576be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:25:26.993891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:25:26.993891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 1415de13612d47928af70862de8576be Jun 07 13:25:26.993891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:25:26.993891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeShelveTestJSON-1678106582-project Jun 07 13:25:26.993891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:25:26.993891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:25:26.993891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: c1785cda265641259d831cb0b6a6a34b Jun 07 13:25:26.993891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1678106582-project Jun 07 13:25:26.993891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:25:26.993891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. Jun 07 13:25:26.993891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': '64eec94b-9fac-4ad4-8386-01a27db4d5ce'} Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:26.994901 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. Jun 07 13:25:26.996924 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:25:26.998494 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1cda2948-7952-46bc-9a08-bebcf7438d77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Returning 404 to user: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:26.998494 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1cda2948-7952-46bc-9a08-bebcf7438d77 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 404 len: 111 microversion: 2.20 time: 0.043315 Jun 07 13:25:26.998494 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 616/1233] 10.222.0.58 () {60 vars in 1279 bytes} [Tue Jun 7 13:25:26 2022] DELETE /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:25:27.002051 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-25461997-3c3e-413a-88a7-1c9121099329 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:27.002750 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-25461997-3c3e-413a-88a7-1c9121099329 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] [instance: 64eec94b-9fac-4ad4-8386-01a27db4d5ce] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:27.004707 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:27.010984 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-25461997-3c3e-413a-88a7-1c9121099329 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:27.011534 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-25461997-3c3e-413a-88a7-1c9121099329 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:27.012383 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-25461997-3c3e-413a-88a7-1c9121099329 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:27.012823 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-25461997-3c3e-413a-88a7-1c9121099329 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:27.030587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-25461997-3c3e-413a-88a7-1c9121099329 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] HTTP exception thrown: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-25461997-3c3e-413a-88a7-1c9121099329 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Request method failure captured: Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce HTTP/1.1 Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin08eIhtdXfyY-F6iLKNsk0VbMyGisWXTCPrvVkXrvT5fDCJuyZZcw7-T-Jncv8mPCJhGVeh-VFdBTSoFpLTmtb7RJQ_7yh9n40ks2CytmiZKVHPovMsBqOMXed6fGVqD0nYtaIzBTCdHz2DgCiEadMveyYNRYGgOlFL_JesnL_gtjAY Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 1415de13612d47928af70862de8576be Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:25:27.032539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:25:27.034238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1415de13612d47928af70862de8576be", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1415de13612d47928af70862de8576be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1415de13612d47928af70862de8576be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1415de13612d47928af70862de8576be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:25:27.034238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:25:27.034238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 1415de13612d47928af70862de8576be Jun 07 13:25:27.034238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1678106582 Jun 07 13:25:27.034238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-AttachVolumeShelveTestJSON-1678106582-project Jun 07 13:25:27.034238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:25:27.034238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:25:27.034238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: c1785cda265641259d831cb0b6a6a34b Jun 07 13:25:27.034238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1678106582-project Jun 07 13:25:27.034238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:25:27.034238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. Jun 07 13:25:27.034238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': '64eec94b-9fac-4ad4-8386-01a27db4d5ce'} Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:27.035175 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. Jun 07 13:25:27.036645 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:25:27.038102 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-25461997-3c3e-413a-88a7-1c9121099329 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] Returning 404 to user: Instance 64eec94b-9fac-4ad4-8386-01a27db4d5ce could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:27.038102 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-25461997-3c3e-413a-88a7-1c9121099329 tempest-AttachVolumeShelveTestJSON-1678106582 tempest-AttachVolumeShelveTestJSON-1678106582-project] 10.222.0.58 "GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce" status: 404 len: 111 microversion: 2.20 time: 0.035912 Jun 07 13:25:27.038102 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 618/1234] 10.222.0.58 () {60 vars in 1276 bytes} [Tue Jun 7 13:25:26 2022] GET /compute/v2.1/servers/64eec94b-9fac-4ad4-8386-01a27db4d5ce => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 07 13:25:27.921509 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2edc2dee-456f-4e1a-a837-b31e96134b31 tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] Calling method '.version_select at 0x7fb8f8f21040>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:27.986767 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2edc2dee-456f-4e1a-a837-b31e96134b31 tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ea5d566d-cfcb-4c3c-970c-02731df4b6ce" status: 200 len: 350 microversion: 2.1 time: 0.071102 Jun 07 13:25:27.990633 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 617/1235] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:25:27 2022] GET /compute/v2.1/os-volumes/ea5d566d-cfcb-4c3c-970c-02731df4b6ce => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:29.409403 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c9b7629c-74d6-4615-9175-f1ceb78a0e79 tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] Calling method '.version_select at 0x7fb8e79c4280>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:29.465073 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c9b7629c-74d6-4615-9175-f1ceb78a0e79 tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2c9f4557-615e-4208-bfd1-d56b2e03c912" status: 200 len: 349 microversion: 2.1 time: 0.060260 Jun 07 13:25:29.465781 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 619/1236] 10.222.0.58 () {58 vars in 1244 bytes} [Tue Jun 7 13:25:29 2022] GET /compute/v2.1/os-volumes/2c9f4557-615e-4208-bfd1-d56b2e03c912 => generated 349 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:29.479599 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cd1eb885-f7f5-409e-9ba6-cb5da5fe3998 tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] Calling method '.version_select at 0x7fb8f8f91ca0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:29.580861 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cd1eb885-f7f5-409e-9ba6-cb5da5fe3998 tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.106843 Jun 07 13:25:29.581650 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 618/1237] 10.222.0.58 () {58 vars in 1133 bytes} [Tue Jun 7 13:25:29 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:29.594726 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-29a8b898-3b57-48b3-9452-a2ef164eea96 tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] Calling method '.version_select at 0x7fb8f4a35d30>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:29.717234 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-29a8b898-3b57-48b3-9452-a2ef164eea96 tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.126563 Jun 07 13:25:29.718054 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 620/1238] 10.222.0.58 () {58 vars in 1148 bytes} [Tue Jun 7 13:25:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:29.729722 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-db205d50-5f0b-47b2-9f02-9bf0853f1691 tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] Calling method '.version_select at 0x7fb8f8f910d0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:29.838352 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-db205d50-5f0b-47b2-9f02-9bf0853f1691 tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.112319 Jun 07 13:25:29.838999 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 619/1239] 10.222.0.58 () {58 vars in 1133 bytes} [Tue Jun 7 13:25:29 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:29.851902 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-09bac2d3-9575-4461-ae8c-3d3de6cf1b7c tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] Calling method '.version_select at 0x7fb8e7951ca0>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:29.955243 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-09bac2d3-9575-4461-ae8c-3d3de6cf1b7c tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.108455 Jun 07 13:25:29.958595 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 621/1240] 10.222.0.58 () {58 vars in 1166 bytes} [Tue Jun 7 13:25:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:29.969004 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3e765122-e581-4573-bc7e-060299f7c8cb tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] Calling method '.version_select at 0x7fb8f8f215e0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:30.083381 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3e765122-e581-4573-bc7e-060299f7c8cb tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.118898 Jun 07 13:25:30.084491 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 620/1241] 10.222.0.58 () {58 vars in 1169 bytes} [Tue Jun 7 13:25:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:30.097149 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1d0db13d-755a-4adb-aca7-24f385fe4bcb tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] Calling method '.version_select at 0x7fb8e7a32ee0>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:30.195502 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1d0db13d-755a-4adb-aca7-24f385fe4bcb tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.102160 Jun 07 13:25:30.196076 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 622/1242] 10.222.0.58 () {58 vars in 1154 bytes} [Tue Jun 7 13:25:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:30.207206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f8c28ba6-6f73-4b29-99a6-e6bf4b8df7f5 tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] Calling method '.version_select at 0x7fb8f422a160>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:30.326407 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f8c28ba6-6f73-4b29-99a6-e6bf4b8df7f5 tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.123021 Jun 07 13:25:30.327002 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 621/1243] 10.222.0.58 () {58 vars in 1187 bytes} [Tue Jun 7 13:25:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:25:30.339587 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9207bf15-2bf1-4728-a72d-93128c8b0af4 tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] Calling method '.version_select at 0x7fb8e795c1f0>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:30.427516 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9207bf15-2bf1-4728-a72d-93128c8b0af4 tempest-VolumesTestJSON-1858995641 tempest-VolumesTestJSON-1858995641-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.091665 Jun 07 13:25:30.428286 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 623/1244] 10.222.0.58 () {58 vars in 1154 bytes} [Tue Jun 7 13:25:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:04.991844 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:04.992616 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=14 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:04.996854 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6092b043-899c-4134-88ad-eb08f025c0a4 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:04.997347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6092b043-899c-4134-88ad-eb08f025c0a4 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:05.004902 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6092b043-899c-4134-88ad-eb08f025c0a4 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:05.005334 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6092b043-899c-4134-88ad-eb08f025c0a4 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:05.006097 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6092b043-899c-4134-88ad-eb08f025c0a4 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:05.006559 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6092b043-899c-4134-88ad-eb08f025c0a4 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:05.033107 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6092b043-899c-4134-88ad-eb08f025c0a4 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:26:05.121739 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6092b043-899c-4134-88ad-eb08f025c0a4 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 204 len: 0 microversion: 2.1 time: 0.130880 Jun 07 13:26:05.122796 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 622/1245] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:26:04 2022] DELETE /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:26:05.131386 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1ce30d48-2f97-49c3-a5fe-b853a66f28b2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:05.132089 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1ce30d48-2f97-49c3-a5fe-b853a66f28b2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:05.135284 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=16 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:05.136618 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:05.143044 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1ce30d48-2f97-49c3-a5fe-b853a66f28b2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:05.143496 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1ce30d48-2f97-49c3-a5fe-b853a66f28b2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:05.144673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1ce30d48-2f97-49c3-a5fe-b853a66f28b2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:05.145124 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1ce30d48-2f97-49c3-a5fe-b853a66f28b2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:05.288554 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1ce30d48-2f97-49c3-a5fe-b853a66f28b2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:05.296006 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1ce30d48-2f97-49c3-a5fe-b853a66f28b2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1576 microversion: 2.1 time: 0.168875 Jun 07 13:26:05.296574 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 624/1246] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:05 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:05.603232 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-644b46ea-74ac-4980-b105-57433e08cc0e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-672701229", "imageRef": "2488a400-0fa6-4da8-a0c4-c2c0986f822e", "flavorRef": "452"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:05.653820 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-644b46ea-74ac-4980-b105-57433e08cc0e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] validate_networks() for None {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:26:05.942729 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-644b46ea-74ac-4980-b105-57433e08cc0e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:26:05.943153 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-644b46ea-74ac-4980-b105-57433e08cc0e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:26:05.943620 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-644b46ea-74ac-4980-b105-57433e08cc0e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:26:05.944025 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-644b46ea-74ac-4980-b105-57433e08cc0e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:26:05.944431 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-644b46ea-74ac-4980-b105-57433e08cc0e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:26:05.953286 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-644b46ea-74ac-4980-b105-57433e08cc0e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:05.953726 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-644b46ea-74ac-4980-b105-57433e08cc0e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:05.954538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-644b46ea-74ac-4980-b105-57433e08cc0e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:05.954970 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-644b46ea-74ac-4980-b105-57433e08cc0e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:05.971765 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-644b46ea-74ac-4980-b105-57433e08cc0e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Getting quotas for project 0a47cc2033934d7a982b6853f983d514. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:26:05.975603 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-644b46ea-74ac-4980-b105-57433e08cc0e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Getting quotas for user 07ee7e5a9dce4a6d8f025468bf33f877 and project 0a47cc2033934d7a982b6853f983d514. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:26:05.986816 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-644b46ea-74ac-4980-b105-57433e08cc0e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:26:05.989104 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-644b46ea-74ac-4980-b105-57433e08cc0e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2488a400-0fa6-4da8-a0c4-c2c0986f822e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:26:06.031564 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-644b46ea-74ac-4980-b105-57433e08cc0e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.433004 Jun 07 13:26:06.032206 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 623/1247] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:26:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:26:06.042859 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-92afc8c9-0ba9-43f3-985b-26572bf1c0e3 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:06.043399 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-92afc8c9-0ba9-43f3-985b-26572bf1c0e3 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:06.093707 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-92afc8c9-0ba9-43f3-985b-26572bf1c0e3 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:06.100325 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-92afc8c9-0ba9-43f3-985b-26572bf1c0e3 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1214 microversion: 2.1 time: 0.061979 Jun 07 13:26:06.100928 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 625/1248] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:06 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1214 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:06.313307 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b188f6e7-51d4-4ab4-8389-e856a704a721 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:06.324837 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b188f6e7-51d4-4ab4-8389-e856a704a721 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:06.325857 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b188f6e7-51d4-4ab4-8389-e856a704a721 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:06.326320 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b188f6e7-51d4-4ab4-8389-e856a704a721 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:06.327208 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b188f6e7-51d4-4ab4-8389-e856a704a721 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:06.327652 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b188f6e7-51d4-4ab4-8389-e856a704a721 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:06.722391 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b188f6e7-51d4-4ab4-8389-e856a704a721 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:06.730375 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b188f6e7-51d4-4ab4-8389-e856a704a721 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1576 microversion: 2.1 time: 0.421194 Jun 07 13:26:06.730970 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 624/1249] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:06 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1576 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:07.119503 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-62c29214-6707-4ea4-8dd8-bdfab863c089 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:07.120128 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-62c29214-6707-4ea4-8dd8-bdfab863c089 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:07.186470 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-62c29214-6707-4ea4-8dd8-bdfab863c089 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:07.195465 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-62c29214-6707-4ea4-8dd8-bdfab863c089 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1214 microversion: 2.1 time: 0.082212 Jun 07 13:26:07.196318 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 626/1250] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:07 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:07.747375 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a47192e9-221a-4f18-82b8-858ef1d25b0a tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:07.747985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a47192e9-221a-4f18-82b8-858ef1d25b0a tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:07.754358 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a47192e9-221a-4f18-82b8-858ef1d25b0a tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:07.754828 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a47192e9-221a-4f18-82b8-858ef1d25b0a tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:07.755583 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a47192e9-221a-4f18-82b8-858ef1d25b0a tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:07.756009 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a47192e9-221a-4f18-82b8-858ef1d25b0a tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:07.886406 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a47192e9-221a-4f18-82b8-858ef1d25b0a tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:07.893757 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a47192e9-221a-4f18-82b8-858ef1d25b0a tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1576 microversion: 2.1 time: 0.150269 Jun 07 13:26:07.894318 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 625/1251] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:07 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:08.212443 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-cbe7f3ad-fae8-4b2e-9aee-fa58e1bc7e12 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:08.213057 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-cbe7f3ad-fae8-4b2e-9aee-fa58e1bc7e12 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:08.267926 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-cbe7f3ad-fae8-4b2e-9aee-fa58e1bc7e12 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:08.275216 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-cbe7f3ad-fae8-4b2e-9aee-fa58e1bc7e12 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1214 microversion: 2.1 time: 0.067118 Jun 07 13:26:08.276401 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 627/1252] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:08 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:08.910676 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e36708f8-24cf-4656-9d16-2b09c9600496 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:08.911280 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e36708f8-24cf-4656-9d16-2b09c9600496 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:08.918143 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e36708f8-24cf-4656-9d16-2b09c9600496 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:08.918629 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e36708f8-24cf-4656-9d16-2b09c9600496 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:08.919387 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e36708f8-24cf-4656-9d16-2b09c9600496 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:08.919819 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e36708f8-24cf-4656-9d16-2b09c9600496 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:09.010429 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e36708f8-24cf-4656-9d16-2b09c9600496 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:09.023091 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-23a18585-84ef-4464-9b3a-837aeaad71f7 req-29941bf2-ac99-44f6-8fad-6ea1281aa001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f62c387-9b2e-4a04-bcf7-db7d688bd6f2", "name": "network-vif-deleted", "tag": "93ee244b-dc39-4f08-b0be-acd8a2ab021d"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:09.032049 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e36708f8-24cf-4656-9d16-2b09c9600496 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1508 microversion: 2.1 time: 0.124623 Jun 07 13:26:09.032970 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-23a18585-84ef-4464-9b3a-837aeaad71f7 req-29941bf2-ac99-44f6-8fad-6ea1281aa001 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:09.033441 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-23a18585-84ef-4464-9b3a-837aeaad71f7 req-29941bf2-ac99-44f6-8fad-6ea1281aa001 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:09.044131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 626/1253] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:08 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1508 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:09.050817 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-23a18585-84ef-4464-9b3a-837aeaad71f7 req-29941bf2-ac99-44f6-8fad-6ea1281aa001 service nova] Creating event network-vif-deleted:93ee244b-dc39-4f08-b0be-acd8a2ab021d for instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 on hv-cinder-84496 Jun 07 13:26:09.056112 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-23a18585-84ef-4464-9b3a-837aeaad71f7 req-29941bf2-ac99-44f6-8fad-6ea1281aa001 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036602 Jun 07 13:26:09.059575 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 628/1254] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:26:09.294851 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f20f6aa7-6f78-48a8-877c-92215c844483 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:09.297161 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f20f6aa7-6f78-48a8-877c-92215c844483 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:09.355648 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f20f6aa7-6f78-48a8-877c-92215c844483 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:09.362434 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f20f6aa7-6f78-48a8-877c-92215c844483 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1214 microversion: 2.1 time: 0.071469 Jun 07 13:26:09.363039 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 627/1255] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:09 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:10.050155 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9c69bcbf-b173-4f1b-aacf-c749b7609a49 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:10.051722 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9c69bcbf-b173-4f1b-aacf-c749b7609a49 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:10.059544 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9c69bcbf-b173-4f1b-aacf-c749b7609a49 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:10.060000 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9c69bcbf-b173-4f1b-aacf-c749b7609a49 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:10.060768 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9c69bcbf-b173-4f1b-aacf-c749b7609a49 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:10.061208 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9c69bcbf-b173-4f1b-aacf-c749b7609a49 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:10.128614 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9c69bcbf-b173-4f1b-aacf-c749b7609a49 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:10.137052 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9c69bcbf-b173-4f1b-aacf-c749b7609a49 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1224 microversion: 2.1 time: 0.091594 Jun 07 13:26:10.137623 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 629/1256] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:10 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:10.379334 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-446d08e5-b289-4e39-b2b8-0666a79bc7fb tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:10.380031 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-446d08e5-b289-4e39-b2b8-0666a79bc7fb tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:10.387866 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-446d08e5-b289-4e39-b2b8-0666a79bc7fb tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:10.388322 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-446d08e5-b289-4e39-b2b8-0666a79bc7fb tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:10.389095 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-446d08e5-b289-4e39-b2b8-0666a79bc7fb tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:10.389541 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-446d08e5-b289-4e39-b2b8-0666a79bc7fb tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:10.449633 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-446d08e5-b289-4e39-b2b8-0666a79bc7fb tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:10.457018 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-446d08e5-b289-4e39-b2b8-0666a79bc7fb tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1218 microversion: 2.1 time: 0.081707 Jun 07 13:26:10.457580 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 628/1257] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:10 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:11.154279 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-80e73416-6c0b-4ad3-a414-b1d6348625ed tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:11.154919 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-80e73416-6c0b-4ad3-a414-b1d6348625ed tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:11.162752 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-80e73416-6c0b-4ad3-a414-b1d6348625ed tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:11.163203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-80e73416-6c0b-4ad3-a414-b1d6348625ed tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:11.163975 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-80e73416-6c0b-4ad3-a414-b1d6348625ed tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:11.164901 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-80e73416-6c0b-4ad3-a414-b1d6348625ed tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:11.197802 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-80e73416-6c0b-4ad3-a414-b1d6348625ed tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:11.198243 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-80e73416-6c0b-4ad3-a414-b1d6348625ed tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:11.198712 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.objects.instance [None req-80e73416-6c0b-4ad3-a414-b1d6348625ed tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lazy-loading 'fault' on Instance uuid 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 {{(pid=117797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:26:11.239799 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-80e73416-6c0b-4ad3-a414-b1d6348625ed tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:11.248261 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-80e73416-6c0b-4ad3-a414-b1d6348625ed tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 200 len: 1229 microversion: 2.1 time: 0.098502 Jun 07 13:26:11.248840 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 630/1258] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:11 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:11.475000 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f7d1434b-7072-4dca-8f1a-b410dfffb5ad tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:11.476674 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f7d1434b-7072-4dca-8f1a-b410dfffb5ad tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:11.485972 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f7d1434b-7072-4dca-8f1a-b410dfffb5ad tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:11.487499 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f7d1434b-7072-4dca-8f1a-b410dfffb5ad tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:11.489027 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f7d1434b-7072-4dca-8f1a-b410dfffb5ad tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:11.489677 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f7d1434b-7072-4dca-8f1a-b410dfffb5ad tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:11.573803 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f7d1434b-7072-4dca-8f1a-b410dfffb5ad tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:11.584253 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f7d1434b-7072-4dca-8f1a-b410dfffb5ad tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1272 microversion: 2.1 time: 0.114246 Jun 07 13:26:11.585751 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 629/1259] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:11 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1272 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:12.266196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-eb32ba59-08d7-4eff-a249-0c10ddda2dd3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:12.266985 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-eb32ba59-08d7-4eff-a249-0c10ddda2dd3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:12.277066 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-eb32ba59-08d7-4eff-a249-0c10ddda2dd3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:12.277872 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-eb32ba59-08d7-4eff-a249-0c10ddda2dd3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:12.279841 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-eb32ba59-08d7-4eff-a249-0c10ddda2dd3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:12.280539 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-eb32ba59-08d7-4eff-a249-0c10ddda2dd3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:12.295032 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-eb32ba59-08d7-4eff-a249-0c10ddda2dd3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] HTTP exception thrown: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-eb32ba59-08d7-4eff-a249-0c10ddda2dd3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Request method failure captured: Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 HTTP/1.1 Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin1D_0QtM6sg7Ez4qwVWHQIyGgPISu3CJ98LK_dWBQ6qYivQ20CFkZFDUL2X2Ba02HCB5Gun0Q4DK2U0aJKtyNrnP2MnEj1nwdDhECa5BKhEe5BCBsPvVjo4aHksL4TGXm36-gZlBslcyAekaqLaTaPRwMRg-ljJD5rPZ0jMuQiQQPBw Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 4a76d6db5fba43409430f5f9920c2943 Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-TestVolumeBootPattern-634091109 Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:26:12.296924 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:26:12.298597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4a76d6db5fba43409430f5f9920c2943", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4a76d6db5fba43409430f5f9920c2943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a76d6db5fba43409430f5f9920c2943"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a76d6db5fba43409430f5f9920c2943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:26:12.298597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-TestVolumeBootPattern-634091109 Jun 07 13:26:12.298597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 4a76d6db5fba43409430f5f9920c2943 Jun 07 13:26:12.298597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-TestVolumeBootPattern-634091109 Jun 07 13:26:12.298597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-TestVolumeBootPattern-634091109-project Jun 07 13:26:12.298597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:26:12.298597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:26:12.298597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 010b37124c114e37966a0e22a24d5b91 Jun 07 13:26:12.298597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-TestVolumeBootPattern-634091109-project Jun 07 13:26:12.298597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:26:12.298597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. Jun 07 13:26:12.298597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': '2f62c387-9b2e-4a04-bcf7-db7d688bd6f2'} Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:26:12.299629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. Jun 07 13:26:12.301252 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:26:12.303418 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-eb32ba59-08d7-4eff-a249-0c10ddda2dd3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Returning 404 to user: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:26:12.304441 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-eb32ba59-08d7-4eff-a249-0c10ddda2dd3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 404 len: 111 microversion: 2.1 time: 0.042228 Jun 07 13:26:12.305690 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 631/1260] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:12 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:26:12.416842 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-dde65f29-245c-4833-a6c3-fbdda36a819b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1007644318", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-34190129", "security_groups": [{"name": "tempest-secgroup-smoke-1052045060"}], "block_device_mapping_v2": [{"uuid": "5d89c8aa-25bc-430f-8d4f-dd4c048d93d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "740c525e-9834-4cf4-9b2c-18b2382f4e9c"}]}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:12.603513 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-1dcc854a-6cfb-48e3-b606-c342090a2622 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:12.604444 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-1dcc854a-6cfb-48e3-b606-c342090a2622 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:12.615668 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1dcc854a-6cfb-48e3-b606-c342090a2622 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:12.616769 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1dcc854a-6cfb-48e3-b606-c342090a2622 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:12.618620 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1dcc854a-6cfb-48e3-b606-c342090a2622 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:12.619641 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-1dcc854a-6cfb-48e3-b606-c342090a2622 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:12.647616 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-dde65f29-245c-4833-a6c3-fbdda36a819b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] validate_networks() for [('740c525e-9834-4cf4-9b2c-18b2382f4e9c', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:26:12.797904 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-1dcc854a-6cfb-48e3-b606-c342090a2622 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:12.806381 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-1dcc854a-6cfb-48e3-b606-c342090a2622 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1314 microversion: 2.1 time: 0.208514 Jun 07 13:26:12.816629 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 632/1261] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:12 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:13.545469 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-dde65f29-245c-4833-a6c3-fbdda36a819b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:26:13.545896 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-dde65f29-245c-4833-a6c3-fbdda36a819b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:26:13.547111 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-dde65f29-245c-4833-a6c3-fbdda36a819b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:26:13.547527 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-dde65f29-245c-4833-a6c3-fbdda36a819b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:26:13.547944 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-dde65f29-245c-4833-a6c3-fbdda36a819b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:26:13.561109 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dde65f29-245c-4833-a6c3-fbdda36a819b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:13.561666 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dde65f29-245c-4833-a6c3-fbdda36a819b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:13.562425 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dde65f29-245c-4833-a6c3-fbdda36a819b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:13.562939 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dde65f29-245c-4833-a6c3-fbdda36a819b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:13.582574 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-dde65f29-245c-4833-a6c3-fbdda36a819b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Getting quotas for project 4a76d6db5fba43409430f5f9920c2943. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:26:13.586740 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-dde65f29-245c-4833-a6c3-fbdda36a819b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Getting quotas for user 010b37124c114e37966a0e22a24d5b91 and project 4a76d6db5fba43409430f5f9920c2943. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:26:13.614909 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-2ccfcea7-1551-4f10-906d-2d5ed8ea3d52 req-9cfe1066-f2e0-4181-b4be-20f41668c4ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064d87c9-0c9f-48b5-96e5-326e6707c4d1", "tag": "446c063b-9a54-4e31-9775-33a3bf1f9eac"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:13.625020 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-2ccfcea7-1551-4f10-906d-2d5ed8ea3d52 req-9cfe1066-f2e0-4181-b4be-20f41668c4ff service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:13.625936 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-2ccfcea7-1551-4f10-906d-2d5ed8ea3d52 req-9cfe1066-f2e0-4181-b4be-20f41668c4ff service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:13.645908 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-2ccfcea7-1551-4f10-906d-2d5ed8ea3d52 req-9cfe1066-f2e0-4181-b4be-20f41668c4ff service nova] Creating event network-changed:446c063b-9a54-4e31-9775-33a3bf1f9eac for instance 064d87c9-0c9f-48b5-96e5-326e6707c4d1 on hv-cinder-84496 Jun 07 13:26:13.655222 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-2ccfcea7-1551-4f10-906d-2d5ed8ea3d52 req-9cfe1066-f2e0-4181-b4be-20f41668c4ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044143 Jun 07 13:26:13.656390 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 633/1262] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:13.669698 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-dde65f29-245c-4833-a6c3-fbdda36a819b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:26:13.672527 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-dde65f29-245c-4833-a6c3-fbdda36a819b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d89c8aa-25bc-430f-8d4f-dd4c048d93d8',volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:26:13.825581 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-48211d2c-dc05-4ef0-8aa2-3663f3bf81ba tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:13.826654 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-48211d2c-dc05-4ef0-8aa2-3663f3bf81ba tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:13.838644 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-48211d2c-dc05-4ef0-8aa2-3663f3bf81ba tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:13.838965 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-48211d2c-dc05-4ef0-8aa2-3663f3bf81ba tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:13.840163 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-48211d2c-dc05-4ef0-8aa2-3663f3bf81ba tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:13.840935 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-48211d2c-dc05-4ef0-8aa2-3663f3bf81ba tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:13.876044 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-dde65f29-245c-4833-a6c3-fbdda36a819b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.463228 Jun 07 13:26:13.879457 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 630/1263] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:26:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:26:13.890338 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a1211666-c4e6-4f96-9241-c1c0f57c59f2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:13.890912 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a1211666-c4e6-4f96-9241-c1c0f57c59f2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:13.978650 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a1211666-c4e6-4f96-9241-c1c0f57c59f2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:13.991310 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a1211666-c4e6-4f96-9241-c1c0f57c59f2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1093 microversion: 2.1 time: 0.108391 Jun 07 13:26:13.993086 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 631/1264] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:13 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1093 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:14.093712 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-48211d2c-dc05-4ef0-8aa2-3663f3bf81ba tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:14.102659 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-48211d2c-dc05-4ef0-8aa2-3663f3bf81ba tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1314 microversion: 2.1 time: 0.282193 Jun 07 13:26:14.112909 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 634/1265] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:13 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:15.009168 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-06bf25e6-8f92-41bb-b1c0-a1a63cfb035f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:15.009785 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-06bf25e6-8f92-41bb-b1c0-a1a63cfb035f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:15.016295 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-06bf25e6-8f92-41bb-b1c0-a1a63cfb035f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:15.016748 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-06bf25e6-8f92-41bb-b1c0-a1a63cfb035f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:15.017514 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-06bf25e6-8f92-41bb-b1c0-a1a63cfb035f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:15.017948 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-06bf25e6-8f92-41bb-b1c0-a1a63cfb035f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:15.083438 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-06bf25e6-8f92-41bb-b1c0-a1a63cfb035f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:15.090799 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-06bf25e6-8f92-41bb-b1c0-a1a63cfb035f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1143 microversion: 2.1 time: 0.085911 Jun 07 13:26:15.091591 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 632/1266] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:15 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:15.119990 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c11c5b12-2cf1-4d9e-8558-553e3f25697f tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:15.120612 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c11c5b12-2cf1-4d9e-8558-553e3f25697f tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:15.127130 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c11c5b12-2cf1-4d9e-8558-553e3f25697f tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:15.127690 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c11c5b12-2cf1-4d9e-8558-553e3f25697f tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:15.128338 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c11c5b12-2cf1-4d9e-8558-553e3f25697f tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:15.128780 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c11c5b12-2cf1-4d9e-8558-553e3f25697f tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:15.264281 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c11c5b12-2cf1-4d9e-8558-553e3f25697f tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:15.271772 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c11c5b12-2cf1-4d9e-8558-553e3f25697f tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1314 microversion: 2.1 time: 0.156053 Jun 07 13:26:15.272451 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 635/1267] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:15 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:16.107805 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ac3c2c86-3ed7-4bed-8e8f-c86d599200ca tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:16.108423 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ac3c2c86-3ed7-4bed-8e8f-c86d599200ca tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:16.114891 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ac3c2c86-3ed7-4bed-8e8f-c86d599200ca tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:16.115353 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ac3c2c86-3ed7-4bed-8e8f-c86d599200ca tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:16.116118 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ac3c2c86-3ed7-4bed-8e8f-c86d599200ca tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:16.116560 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ac3c2c86-3ed7-4bed-8e8f-c86d599200ca tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:16.187695 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ac3c2c86-3ed7-4bed-8e8f-c86d599200ca tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:16.196226 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ac3c2c86-3ed7-4bed-8e8f-c86d599200ca tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1143 microversion: 2.1 time: 0.091833 Jun 07 13:26:16.196804 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 633/1268] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:16 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1143 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:16.290489 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-e1ad5da1-c779-43e8-90bd-648f0e3b3922 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:16.291354 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-e1ad5da1-c779-43e8-90bd-648f0e3b3922 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:16.299730 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e1ad5da1-c779-43e8-90bd-648f0e3b3922 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:16.300203 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e1ad5da1-c779-43e8-90bd-648f0e3b3922 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:16.301238 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e1ad5da1-c779-43e8-90bd-648f0e3b3922 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:16.301694 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-e1ad5da1-c779-43e8-90bd-648f0e3b3922 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:16.457142 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-e1ad5da1-c779-43e8-90bd-648f0e3b3922 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:16.465024 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-e1ad5da1-c779-43e8-90bd-648f0e3b3922 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1314 microversion: 2.1 time: 0.179873 Jun 07 13:26:16.465839 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 636/1269] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:16 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:17.214105 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-73487abf-6b23-4704-9941-a1e35dcb62aa tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:17.214862 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-73487abf-6b23-4704-9941-a1e35dcb62aa tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:17.221282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-73487abf-6b23-4704-9941-a1e35dcb62aa tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:17.221808 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-73487abf-6b23-4704-9941-a1e35dcb62aa tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:17.222705 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-73487abf-6b23-4704-9941-a1e35dcb62aa tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:17.223214 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-73487abf-6b23-4704-9941-a1e35dcb62aa tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:17.288282 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-73487abf-6b23-4704-9941-a1e35dcb62aa tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:17.296306 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-73487abf-6b23-4704-9941-a1e35dcb62aa tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1209 microversion: 2.1 time: 0.086896 Jun 07 13:26:17.296870 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 634/1270] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:17 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:17.482854 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b1644300-aec1-498c-ad01-c2721a23d1f9 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:17.483472 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b1644300-aec1-498c-ad01-c2721a23d1f9 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:17.490049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b1644300-aec1-498c-ad01-c2721a23d1f9 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:17.490525 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b1644300-aec1-498c-ad01-c2721a23d1f9 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:17.491449 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b1644300-aec1-498c-ad01-c2721a23d1f9 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:17.491889 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b1644300-aec1-498c-ad01-c2721a23d1f9 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:17.626498 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b1644300-aec1-498c-ad01-c2721a23d1f9 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:17.633797 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b1644300-aec1-498c-ad01-c2721a23d1f9 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1314 microversion: 2.1 time: 0.154848 Jun 07 13:26:17.634361 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 637/1271] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:17 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:18.312932 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d424436e-7dd0-4c5b-82f5-56b710b52ba1 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:18.313539 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d424436e-7dd0-4c5b-82f5-56b710b52ba1 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:18.320028 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d424436e-7dd0-4c5b-82f5-56b710b52ba1 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:18.320505 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d424436e-7dd0-4c5b-82f5-56b710b52ba1 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:18.321807 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d424436e-7dd0-4c5b-82f5-56b710b52ba1 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:18.322235 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d424436e-7dd0-4c5b-82f5-56b710b52ba1 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:18.389845 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d424436e-7dd0-4c5b-82f5-56b710b52ba1 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:18.397393 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d424436e-7dd0-4c5b-82f5-56b710b52ba1 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1209 microversion: 2.1 time: 0.088234 Jun 07 13:26:18.397971 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 635/1272] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:18 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:18.651411 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-47c6907a-56ce-4667-bc75-ca76e5acb9e2 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:18.652246 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-47c6907a-56ce-4667-bc75-ca76e5acb9e2 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:18.654200 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=6 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:18.660384 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-47c6907a-56ce-4667-bc75-ca76e5acb9e2 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:18.660844 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-47c6907a-56ce-4667-bc75-ca76e5acb9e2 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:18.661619 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-47c6907a-56ce-4667-bc75-ca76e5acb9e2 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:18.662054 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-47c6907a-56ce-4667-bc75-ca76e5acb9e2 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:18.820374 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-47c6907a-56ce-4667-bc75-ca76e5acb9e2 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:18.829829 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-47c6907a-56ce-4667-bc75-ca76e5acb9e2 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1314 microversion: 2.1 time: 0.182356 Jun 07 13:26:18.832617 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 638/1273] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:18 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:18.913062 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:26:18.913239 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Tue Jun 7 13:26:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:26:19.413133 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-acd50b2e-6e1e-4a31-8a38-12ba57b4ce11 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:19.413660 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-acd50b2e-6e1e-4a31-8a38-12ba57b4ce11 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:19.420234 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-acd50b2e-6e1e-4a31-8a38-12ba57b4ce11 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:19.420680 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-acd50b2e-6e1e-4a31-8a38-12ba57b4ce11 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:19.421436 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-acd50b2e-6e1e-4a31-8a38-12ba57b4ce11 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:19.421868 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-acd50b2e-6e1e-4a31-8a38-12ba57b4ce11 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:19.557262 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-acd50b2e-6e1e-4a31-8a38-12ba57b4ce11 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:19.565792 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-acd50b2e-6e1e-4a31-8a38-12ba57b4ce11 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1277 microversion: 2.1 time: 0.156388 Jun 07 13:26:19.566812 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 636/1274] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:19 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:19.848990 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-ce4ecdfb-70f4-4ba0-84e2-7f41ecedee2c tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:19.849700 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-ce4ecdfb-70f4-4ba0-84e2-7f41ecedee2c tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:19.856683 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce4ecdfb-70f4-4ba0-84e2-7f41ecedee2c tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:19.857131 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce4ecdfb-70f4-4ba0-84e2-7f41ecedee2c tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:19.857925 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce4ecdfb-70f4-4ba0-84e2-7f41ecedee2c tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:19.858365 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-ce4ecdfb-70f4-4ba0-84e2-7f41ecedee2c tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:19.987315 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-ce4ecdfb-70f4-4ba0-84e2-7f41ecedee2c tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:19.995243 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-ce4ecdfb-70f4-4ba0-84e2-7f41ecedee2c tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1314 microversion: 2.1 time: 0.150135 Jun 07 13:26:19.995805 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 639/1275] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:19 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:20.584693 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2a26bacc-aeb3-465e-93db-48aeecd6ec7c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:20.585319 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2a26bacc-aeb3-465e-93db-48aeecd6ec7c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:20.593142 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2a26bacc-aeb3-465e-93db-48aeecd6ec7c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:20.593594 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2a26bacc-aeb3-465e-93db-48aeecd6ec7c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:20.594669 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2a26bacc-aeb3-465e-93db-48aeecd6ec7c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:20.595116 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2a26bacc-aeb3-465e-93db-48aeecd6ec7c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:20.853081 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2a26bacc-aeb3-465e-93db-48aeecd6ec7c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:20.862364 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2a26bacc-aeb3-465e-93db-48aeecd6ec7c tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1277 microversion: 2.1 time: 0.281694 Jun 07 13:26:20.863283 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 637/1276] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:20 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1277 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:21.012759 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-6a7d9286-291c-46da-b870-519f9004b5ad tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:21.013578 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-6a7d9286-291c-46da-b870-519f9004b5ad tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:21.020536 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6a7d9286-291c-46da-b870-519f9004b5ad tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:21.021080 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6a7d9286-291c-46da-b870-519f9004b5ad tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:21.021919 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6a7d9286-291c-46da-b870-519f9004b5ad tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:21.022363 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-6a7d9286-291c-46da-b870-519f9004b5ad tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:21.177745 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-6a7d9286-291c-46da-b870-519f9004b5ad tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:21.188383 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-6a7d9286-291c-46da-b870-519f9004b5ad tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1314 microversion: 2.1 time: 0.179131 Jun 07 13:26:21.189467 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 640/1277] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:21 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:21.424286 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-fcf1041c-39d1-4638-b001-873d24913a66 req-3b61c444-3df5-43c3-90cf-092a41398ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c", "tag": "51d4f939-561d-4cea-ac43-bac8a7d80e32"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:21.439783 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-fcf1041c-39d1-4638-b001-873d24913a66 req-3b61c444-3df5-43c3-90cf-092a41398ba0 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:21.440230 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-fcf1041c-39d1-4638-b001-873d24913a66 req-3b61c444-3df5-43c3-90cf-092a41398ba0 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:21.465312 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-fcf1041c-39d1-4638-b001-873d24913a66 req-3b61c444-3df5-43c3-90cf-092a41398ba0 service nova] Creating event network-changed:51d4f939-561d-4cea-ac43-bac8a7d80e32 for instance e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c on hv-cinder-84496 Jun 07 13:26:21.470392 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-fcf1041c-39d1-4638-b001-873d24913a66 req-3b61c444-3df5-43c3-90cf-092a41398ba0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056817 Jun 07 13:26:21.471412 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 638/1278] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:21.880825 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-b8924bd1-5682-4f79-a20f-7a07b94419f0 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:21.881742 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-b8924bd1-5682-4f79-a20f-7a07b94419f0 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:21.900264 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b8924bd1-5682-4f79-a20f-7a07b94419f0 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:21.901406 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b8924bd1-5682-4f79-a20f-7a07b94419f0 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:21.904756 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b8924bd1-5682-4f79-a20f-7a07b94419f0 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:21.905234 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-b8924bd1-5682-4f79-a20f-7a07b94419f0 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:22.059628 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-b8924bd1-5682-4f79-a20f-7a07b94419f0 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:22.068859 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-b8924bd1-5682-4f79-a20f-7a07b94419f0 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1277 microversion: 2.1 time: 0.192031 Jun 07 13:26:22.069440 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 641/1279] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:21 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:22.205599 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e6b7c925-c06e-42a8-8836-779da5615a95 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:22.206304 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e6b7c925-c06e-42a8-8836-779da5615a95 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:22.213935 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e6b7c925-c06e-42a8-8836-779da5615a95 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:22.214415 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e6b7c925-c06e-42a8-8836-779da5615a95 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:22.215336 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e6b7c925-c06e-42a8-8836-779da5615a95 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:22.215918 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e6b7c925-c06e-42a8-8836-779da5615a95 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:22.361233 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e6b7c925-c06e-42a8-8836-779da5615a95 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:22.369494 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e6b7c925-c06e-42a8-8836-779da5615a95 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1314 microversion: 2.1 time: 0.168144 Jun 07 13:26:22.370075 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 639/1280] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:22 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:22.709875 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-febed8ea-691b-42dc-8d22-8ef6d872082b req-78c87a2b-4716-41cc-89a2-5f664824d2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064d87c9-0c9f-48b5-96e5-326e6707c4d1", "name": "network-vif-plugged", "status": "completed", "tag": "446c063b-9a54-4e31-9775-33a3bf1f9eac"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:22.717882 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-febed8ea-691b-42dc-8d22-8ef6d872082b req-78c87a2b-4716-41cc-89a2-5f664824d2b0 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:22.718323 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-febed8ea-691b-42dc-8d22-8ef6d872082b req-78c87a2b-4716-41cc-89a2-5f664824d2b0 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:22.728916 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-febed8ea-691b-42dc-8d22-8ef6d872082b req-78c87a2b-4716-41cc-89a2-5f664824d2b0 service nova] Creating event network-vif-plugged:446c063b-9a54-4e31-9775-33a3bf1f9eac for instance 064d87c9-0c9f-48b5-96e5-326e6707c4d1 on hv-cinder-84496 Jun 07 13:26:22.735030 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-febed8ea-691b-42dc-8d22-8ef6d872082b req-78c87a2b-4716-41cc-89a2-5f664824d2b0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151664 Jun 07 13:26:22.735609 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 642/1281] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:23.090219 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8d8a9c8b-4247-4431-9cb8-8b0c1166e7ec tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:23.091318 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8d8a9c8b-4247-4431-9cb8-8b0c1166e7ec tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:23.097992 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8d8a9c8b-4247-4431-9cb8-8b0c1166e7ec tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:23.098790 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8d8a9c8b-4247-4431-9cb8-8b0c1166e7ec tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:23.099909 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8d8a9c8b-4247-4431-9cb8-8b0c1166e7ec tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:23.100347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8d8a9c8b-4247-4431-9cb8-8b0c1166e7ec tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:23.292634 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8d8a9c8b-4247-4431-9cb8-8b0c1166e7ec tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:23.299269 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:23.302092 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8d8a9c8b-4247-4431-9cb8-8b0c1166e7ec tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1265 microversion: 2.1 time: 0.215976 Jun 07 13:26:23.302809 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 640/1282] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:23 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:23.387574 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-c31e67a5-4d42-4b66-8a16-427d29a9b017 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:23.388430 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-c31e67a5-4d42-4b66-8a16-427d29a9b017 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:23.395547 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c31e67a5-4d42-4b66-8a16-427d29a9b017 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:23.398220 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c31e67a5-4d42-4b66-8a16-427d29a9b017 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:23.398220 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c31e67a5-4d42-4b66-8a16-427d29a9b017 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:23.398220 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-c31e67a5-4d42-4b66-8a16-427d29a9b017 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:23.616624 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-c31e67a5-4d42-4b66-8a16-427d29a9b017 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:23.625882 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-c31e67a5-4d42-4b66-8a16-427d29a9b017 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1314 microversion: 2.1 time: 0.242789 Jun 07 13:26:23.626597 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 643/1283] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:23 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:24.321538 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2b9c959c-2183-4089-ba20-55803e97cacc tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:24.322391 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2b9c959c-2183-4089-ba20-55803e97cacc tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:24.325458 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=4 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:24.326398 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=16 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:24.335738 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2b9c959c-2183-4089-ba20-55803e97cacc tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.336975 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2b9c959c-2183-4089-ba20-55803e97cacc tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.337999 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2b9c959c-2183-4089-ba20-55803e97cacc tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.338956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2b9c959c-2183-4089-ba20-55803e97cacc tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.499831 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2b9c959c-2183-4089-ba20-55803e97cacc tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:24.507407 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2b9c959c-2183-4089-ba20-55803e97cacc tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1265 microversion: 2.1 time: 0.191461 Jun 07 13:26:24.508504 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 641/1284] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:24 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:24.642666 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-975a7b04-e539-4713-8447-97881158e241 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:24.643281 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-975a7b04-e539-4713-8447-97881158e241 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:24.650495 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-975a7b04-e539-4713-8447-97881158e241 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.650951 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-975a7b04-e539-4713-8447-97881158e241 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.651993 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-975a7b04-e539-4713-8447-97881158e241 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.652432 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-975a7b04-e539-4713-8447-97881158e241 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.786364 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-975a7b04-e539-4713-8447-97881158e241 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:24.793869 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-975a7b04-e539-4713-8447-97881158e241 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1464 microversion: 2.1 time: 0.155114 Jun 07 13:26:24.794430 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 644/1285] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:24 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:24.837662 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a9c6aa33-95a4-4cf8-8928-20490f5356a5 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:24.838226 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a9c6aa33-95a4-4cf8-8928-20490f5356a5 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:24.844315 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a9c6aa33-95a4-4cf8-8928-20490f5356a5 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.844768 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a9c6aa33-95a4-4cf8-8928-20490f5356a5 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.845537 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a9c6aa33-95a4-4cf8-8928-20490f5356a5 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.845983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a9c6aa33-95a4-4cf8-8928-20490f5356a5 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.872220 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a9c6aa33-95a4-4cf8-8928-20490f5356a5 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:26:24.956920 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a9c6aa33-95a4-4cf8-8928-20490f5356a5 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "DELETE /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 204 len: 0 microversion: 2.1 time: 0.123167 Jun 07 13:26:24.957525 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 642/1286] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:26:24 2022] DELETE /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:26:24.965607 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a45a8280-ae96-406b-a96e-0b23591de9d1 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:24.966144 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a45a8280-ae96-406b-a96e-0b23591de9d1 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:24.972084 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a45a8280-ae96-406b-a96e-0b23591de9d1 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.972523 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a45a8280-ae96-406b-a96e-0b23591de9d1 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.973265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a45a8280-ae96-406b-a96e-0b23591de9d1 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.973692 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a45a8280-ae96-406b-a96e-0b23591de9d1 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:25.109547 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a45a8280-ae96-406b-a96e-0b23591de9d1 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:25.113173 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=100 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:25.119614 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a45a8280-ae96-406b-a96e-0b23591de9d1 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1470 microversion: 2.1 time: 0.157837 Jun 07 13:26:25.120217 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 645/1287] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:24 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:25.525911 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-17c55088-3220-4108-9205-d0a944c3b7ab tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:25.526805 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-17c55088-3220-4108-9205-d0a944c3b7ab tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:25.533189 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-17c55088-3220-4108-9205-d0a944c3b7ab tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:25.533632 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-17c55088-3220-4108-9205-d0a944c3b7ab tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:25.534385 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-17c55088-3220-4108-9205-d0a944c3b7ab tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:25.534839 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-17c55088-3220-4108-9205-d0a944c3b7ab tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:25.661724 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-17c55088-3220-4108-9205-d0a944c3b7ab tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:25.669683 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-17c55088-3220-4108-9205-d0a944c3b7ab tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1265 microversion: 2.1 time: 0.148617 Jun 07 13:26:25.670248 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 643/1288] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:25 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:26.136221 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-775c9154-29a2-425b-a44f-e9adefabdf6e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:26.136747 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-775c9154-29a2-425b-a44f-e9adefabdf6e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:26.143625 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-775c9154-29a2-425b-a44f-e9adefabdf6e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:26.144074 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-775c9154-29a2-425b-a44f-e9adefabdf6e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:26.144825 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-775c9154-29a2-425b-a44f-e9adefabdf6e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:26.145257 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-775c9154-29a2-425b-a44f-e9adefabdf6e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:26.277926 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-775c9154-29a2-425b-a44f-e9adefabdf6e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:26.285507 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-775c9154-29a2-425b-a44f-e9adefabdf6e tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1470 microversion: 2.1 time: 0.153708 Jun 07 13:26:26.286076 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 646/1289] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:26 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:26.686187 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6a6ca450-84b1-46e9-97da-b7e7271b1c28 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:26.686938 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6a6ca450-84b1-46e9-97da-b7e7271b1c28 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:26.693774 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6a6ca450-84b1-46e9-97da-b7e7271b1c28 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:26.694468 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6a6ca450-84b1-46e9-97da-b7e7271b1c28 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:26.695916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6a6ca450-84b1-46e9-97da-b7e7271b1c28 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:26.696354 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6a6ca450-84b1-46e9-97da-b7e7271b1c28 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:26.912355 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6a6ca450-84b1-46e9-97da-b7e7271b1c28 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:26.919982 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6a6ca450-84b1-46e9-97da-b7e7271b1c28 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1265 microversion: 2.1 time: 0.237527 Jun 07 13:26:26.920446 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 644/1290] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:26 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:27.147751 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-4c48af69-54f0-41e6-86ef-f4c2d2f05fb9 req-4e6fb0a7-f830-41ec-aef7-7910c634f71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064d87c9-0c9f-48b5-96e5-326e6707c4d1", "name": "network-vif-deleted", "tag": "446c063b-9a54-4e31-9775-33a3bf1f9eac"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:27.157061 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-4c48af69-54f0-41e6-86ef-f4c2d2f05fb9 req-4e6fb0a7-f830-41ec-aef7-7910c634f71e service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:27.157460 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-4c48af69-54f0-41e6-86ef-f4c2d2f05fb9 req-4e6fb0a7-f830-41ec-aef7-7910c634f71e service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:27.175654 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-4c48af69-54f0-41e6-86ef-f4c2d2f05fb9 req-4e6fb0a7-f830-41ec-aef7-7910c634f71e service nova] Creating event network-vif-deleted:446c063b-9a54-4e31-9775-33a3bf1f9eac for instance 064d87c9-0c9f-48b5-96e5-326e6707c4d1 on hv-cinder-84496 Jun 07 13:26:27.182362 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-4c48af69-54f0-41e6-86ef-f4c2d2f05fb9 req-4e6fb0a7-f830-41ec-aef7-7910c634f71e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038465 Jun 07 13:26:27.185934 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 647/1291] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:27.302124 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-74f46626-059a-4023-ac71-d419f1c2cb69 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:27.302895 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-74f46626-059a-4023-ac71-d419f1c2cb69 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:27.309042 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-74f46626-059a-4023-ac71-d419f1c2cb69 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:27.309499 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-74f46626-059a-4023-ac71-d419f1c2cb69 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:27.310278 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-74f46626-059a-4023-ac71-d419f1c2cb69 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:27.310743 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-74f46626-059a-4023-ac71-d419f1c2cb69 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:27.341649 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-74f46626-059a-4023-ac71-d419f1c2cb69 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:27.342107 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-74f46626-059a-4023-ac71-d419f1c2cb69 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:27.342600 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-74f46626-059a-4023-ac71-d419f1c2cb69 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lazy-loading 'fault' on Instance uuid 064d87c9-0c9f-48b5-96e5-326e6707c4d1 {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:26:27.381700 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-74f46626-059a-4023-ac71-d419f1c2cb69 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ee7e5a9dce4a6d8f025468bf33f877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a47cc2033934d7a982b6853f983d514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:27.389809 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-74f46626-059a-4023-ac71-d419f1c2cb69 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 200 len: 1304 microversion: 2.1 time: 0.091463 Jun 07 13:26:27.390386 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 645/1292] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:27 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:27.936158 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-855517f8-60e5-48e4-92ce-fdaaf055303e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:27.936953 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-855517f8-60e5-48e4-92ce-fdaaf055303e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:27.943282 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-855517f8-60e5-48e4-92ce-fdaaf055303e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:27.943731 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-855517f8-60e5-48e4-92ce-fdaaf055303e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:27.944566 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-855517f8-60e5-48e4-92ce-fdaaf055303e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:27.944999 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-855517f8-60e5-48e4-92ce-fdaaf055303e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:28.074745 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-855517f8-60e5-48e4-92ce-fdaaf055303e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:28.082068 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-855517f8-60e5-48e4-92ce-fdaaf055303e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1265 microversion: 2.1 time: 0.150106 Jun 07 13:26:28.082673 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 648/1293] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:27 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:28.407115 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-05ba924f-6a2d-4fef-b6ed-f6b902dad983 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:28.407775 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-05ba924f-6a2d-4fef-b6ed-f6b902dad983 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] [instance: 064d87c9-0c9f-48b5-96e5-326e6707c4d1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:28.414177 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-05ba924f-6a2d-4fef-b6ed-f6b902dad983 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:28.414679 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-05ba924f-6a2d-4fef-b6ed-f6b902dad983 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:28.415443 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-05ba924f-6a2d-4fef-b6ed-f6b902dad983 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:28.415884 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-05ba924f-6a2d-4fef-b6ed-f6b902dad983 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:28.429044 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-05ba924f-6a2d-4fef-b6ed-f6b902dad983 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] HTTP exception thrown: Instance 064d87c9-0c9f-48b5-96e5-326e6707c4d1 could not be found. Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-05ba924f-6a2d-4fef-b6ed-f6b902dad983 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Request method failure captured: Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 HTTP/1.1 Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin1HsN6v-lij1LvSulEN3HRmrLfUNPvmu-3XJg-4IGj6BsF3hFxNoQs_1szkHm-XC_6FXcEFz0B0DaeM-leEaiVGnveYGxdix93maeIFC16YfwZPumCCpZUm1EhyJnXfwWKOao7Cpm-1j52zg313CqnhRZPuA1RqH36Q6Lp6HbeSfsM4 Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 0a47cc2033934d7a982b6853f983d514 Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-VolumesNegativeTest-1026177014 Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:26:28.431192 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:26:28.432883 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0a47cc2033934d7a982b6853f983d514", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0a47cc2033934d7a982b6853f983d514"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0a47cc2033934d7a982b6853f983d514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0a47cc2033934d7a982b6853f983d514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:26:28.432883 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-VolumesNegativeTest-1026177014 Jun 07 13:26:28.432883 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 0a47cc2033934d7a982b6853f983d514 Jun 07 13:26:28.432883 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-VolumesNegativeTest-1026177014 Jun 07 13:26:28.432883 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-VolumesNegativeTest-1026177014-project Jun 07 13:26:28.432883 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:26:28.432883 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:26:28.432883 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 07ee7e5a9dce4a6d8f025468bf33f877 Jun 07 13:26:28.432883 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-VolumesNegativeTest-1026177014-project Jun 07 13:26:28.432883 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:26:28.432883 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance 064d87c9-0c9f-48b5-96e5-326e6707c4d1 could not be found. Jun 07 13:26:28.432883 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': '064d87c9-0c9f-48b5-96e5-326e6707c4d1'} Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 064d87c9-0c9f-48b5-96e5-326e6707c4d1 could not be found. Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:26:28.433916 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 064d87c9-0c9f-48b5-96e5-326e6707c4d1 could not be found. Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 064d87c9-0c9f-48b5-96e5-326e6707c4d1 could not be found. Jun 07 13:26:28.435554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:26:28.437032 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-05ba924f-6a2d-4fef-b6ed-f6b902dad983 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] Returning 404 to user: Instance 064d87c9-0c9f-48b5-96e5-326e6707c4d1 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:26:28.437032 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-05ba924f-6a2d-4fef-b6ed-f6b902dad983 tempest-VolumesNegativeTest-1026177014 tempest-VolumesNegativeTest-1026177014-project] 10.222.0.58 "GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1" status: 404 len: 111 microversion: 2.1 time: 0.029394 Jun 07 13:26:28.437032 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 646/1294] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:28 2022] GET /compute/v2.1/servers/064d87c9-0c9f-48b5-96e5-326e6707c4d1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:26:29.098556 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-48a20a69-bfac-489e-9db1-49173cff7af9 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:29.099170 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-48a20a69-bfac-489e-9db1-49173cff7af9 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:29.105760 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-48a20a69-bfac-489e-9db1-49173cff7af9 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:29.106265 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-48a20a69-bfac-489e-9db1-49173cff7af9 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:29.106974 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-48a20a69-bfac-489e-9db1-49173cff7af9 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:29.107407 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-48a20a69-bfac-489e-9db1-49173cff7af9 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:29.263097 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-48a20a69-bfac-489e-9db1-49173cff7af9 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:29.271196 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-48a20a69-bfac-489e-9db1-49173cff7af9 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1265 microversion: 2.1 time: 0.176236 Jun 07 13:26:29.278894 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 649/1295] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:29 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:30.291965 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-79c38be4-cdf0-4049-ab6e-f60312aafb10 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:30.292604 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-79c38be4-cdf0-4049-ab6e-f60312aafb10 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:30.296306 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:30.300222 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-79c38be4-cdf0-4049-ab6e-f60312aafb10 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:30.300672 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-79c38be4-cdf0-4049-ab6e-f60312aafb10 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:30.301451 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-79c38be4-cdf0-4049-ab6e-f60312aafb10 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:30.302618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-79c38be4-cdf0-4049-ab6e-f60312aafb10 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:30.465202 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-79c38be4-cdf0-4049-ab6e-f60312aafb10 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:30.474236 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-79c38be4-cdf0-4049-ab6e-f60312aafb10 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1265 microversion: 2.1 time: 0.189986 Jun 07 13:26:30.485554 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 647/1296] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:30 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:31.491308 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-f59f0487-0a26-499b-aa8f-6ea1c875ee55 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:31.491930 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-f59f0487-0a26-499b-aa8f-6ea1c875ee55 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:31.499564 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f59f0487-0a26-499b-aa8f-6ea1c875ee55 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:31.500589 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f59f0487-0a26-499b-aa8f-6ea1c875ee55 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:31.501508 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f59f0487-0a26-499b-aa8f-6ea1c875ee55 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:31.501997 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-f59f0487-0a26-499b-aa8f-6ea1c875ee55 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:31.632200 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-f59f0487-0a26-499b-aa8f-6ea1c875ee55 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:31.639659 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-f59f0487-0a26-499b-aa8f-6ea1c875ee55 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1265 microversion: 2.1 time: 0.152136 Jun 07 13:26:31.640225 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 650/1297] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:31 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:32.583276 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-042e8015-8548-4714-bcfd-acdeae334430 req-c84a453a-0631-4611-9263-31d2061b1282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c", "name": "network-vif-plugged", "status": "completed", "tag": "51d4f939-561d-4cea-ac43-bac8a7d80e32"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:32.592985 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-042e8015-8548-4714-bcfd-acdeae334430 req-c84a453a-0631-4611-9263-31d2061b1282 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:32.593589 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-042e8015-8548-4714-bcfd-acdeae334430 req-c84a453a-0631-4611-9263-31d2061b1282 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:32.609000 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-042e8015-8548-4714-bcfd-acdeae334430 req-c84a453a-0631-4611-9263-31d2061b1282 service nova] Creating event network-vif-plugged:51d4f939-561d-4cea-ac43-bac8a7d80e32 for instance e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c on hv-cinder-84496 Jun 07 13:26:32.614315 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-042e8015-8548-4714-bcfd-acdeae334430 req-c84a453a-0631-4611-9263-31d2061b1282 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034593 Jun 07 13:26:32.615207 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 648/1298] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:26:32.657578 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-565178ca-fdfa-4b86-bff1-b7a73c52d84d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:32.658923 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-565178ca-fdfa-4b86-bff1-b7a73c52d84d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:32.665360 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-565178ca-fdfa-4b86-bff1-b7a73c52d84d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:32.666363 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-565178ca-fdfa-4b86-bff1-b7a73c52d84d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:32.667168 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-565178ca-fdfa-4b86-bff1-b7a73c52d84d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:32.667600 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-565178ca-fdfa-4b86-bff1-b7a73c52d84d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:32.847177 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-565178ca-fdfa-4b86-bff1-b7a73c52d84d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:32.859093 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-565178ca-fdfa-4b86-bff1-b7a73c52d84d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1265 microversion: 2.1 time: 0.205094 Jun 07 13:26:32.863971 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 651/1299] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:32 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:33.878028 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-97b198e0-7698-419b-a8f2-2f522adf8ccb tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:33.878749 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-97b198e0-7698-419b-a8f2-2f522adf8ccb tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:33.884854 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-97b198e0-7698-419b-a8f2-2f522adf8ccb tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:33.885292 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-97b198e0-7698-419b-a8f2-2f522adf8ccb tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:33.886041 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-97b198e0-7698-419b-a8f2-2f522adf8ccb tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:33.886522 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-97b198e0-7698-419b-a8f2-2f522adf8ccb tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:34.016488 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-97b198e0-7698-419b-a8f2-2f522adf8ccb tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:34.024880 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-97b198e0-7698-419b-a8f2-2f522adf8ccb tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1265 microversion: 2.1 time: 0.151501 Jun 07 13:26:34.025425 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 649/1300] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:33 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:35.041887 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-179915a3-511b-41f0-aa22-0c93eed2ffba tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:35.042517 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-179915a3-511b-41f0-aa22-0c93eed2ffba tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:35.048932 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-179915a3-511b-41f0-aa22-0c93eed2ffba tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:35.049378 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-179915a3-511b-41f0-aa22-0c93eed2ffba tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:35.050128 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-179915a3-511b-41f0-aa22-0c93eed2ffba tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:35.050593 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-179915a3-511b-41f0-aa22-0c93eed2ffba tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:35.181867 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-179915a3-511b-41f0-aa22-0c93eed2ffba tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:35.189568 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-179915a3-511b-41f0-aa22-0c93eed2ffba tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1452 microversion: 2.1 time: 0.152201 Jun 07 13:26:35.190334 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 652/1301] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:35 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:35.205813 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-04b18441-19dc-413b-a82d-72d311249a5f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:35.206470 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-04b18441-19dc-413b-a82d-72d311249a5f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:35.213781 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-04b18441-19dc-413b-a82d-72d311249a5f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:35.214240 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-04b18441-19dc-413b-a82d-72d311249a5f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:35.215039 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-04b18441-19dc-413b-a82d-72d311249a5f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:35.215482 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-04b18441-19dc-413b-a82d-72d311249a5f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:35.411295 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-04b18441-19dc-413b-a82d-72d311249a5f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:35.419892 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-04b18441-19dc-413b-a82d-72d311249a5f tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1452 microversion: 2.1 time: 0.217970 Jun 07 13:26:35.420480 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 650/1302] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:35 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1452 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:37.040749 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-1072cd6e-f446-421c-bfc0-d913cb76b8cb req-d6318615-c697-413f-93e7-f127c0c017fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c", "tag": "51d4f939-561d-4cea-ac43-bac8a7d80e32"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:37.045878 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=67 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:37.050423 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-1072cd6e-f446-421c-bfc0-d913cb76b8cb req-d6318615-c697-413f-93e7-f127c0c017fc service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:37.050881 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-1072cd6e-f446-421c-bfc0-d913cb76b8cb req-d6318615-c697-413f-93e7-f127c0c017fc service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:37.061910 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-1072cd6e-f446-421c-bfc0-d913cb76b8cb req-d6318615-c697-413f-93e7-f127c0c017fc service nova] Creating event network-changed:51d4f939-561d-4cea-ac43-bac8a7d80e32 for instance e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c on hv-cinder-84496 Jun 07 13:26:37.066818 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-1072cd6e-f446-421c-bfc0-d913cb76b8cb req-d6318615-c697-413f-93e7-f127c0c017fc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032138 Jun 07 13:26:37.067386 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 653/1303] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:39.565996 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR oslo.messaging._drivers.impl_rabbit [-] [77bba584-d6ae-4a71-85e3-d82570c966d7] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 07 13:28:39.566613 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:39.567358 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:39.571726 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-95b3a6f7-e4de-4b63-aff8-b5183eede52e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-699154476", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-34190129", "security_groups": [{"name": "tempest-secgroup-smoke-1052045060"}], "block_device_mapping_v2": [{"uuid": "e78a4e3c-2bbc-412b-bc58-ae2332768bee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "740c525e-9834-4cf4-9b2c-18b2382f4e9c"}]}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:39.683650 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-95b3a6f7-e4de-4b63-aff8-b5183eede52e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] validate_networks() for [('740c525e-9834-4cf4-9b2c-18b2382f4e9c', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:28:40.061798 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-95b3a6f7-e4de-4b63-aff8-b5183eede52e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:28:40.062223 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-95b3a6f7-e4de-4b63-aff8-b5183eede52e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:28:40.062743 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-95b3a6f7-e4de-4b63-aff8-b5183eede52e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:28:40.063151 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-95b3a6f7-e4de-4b63-aff8-b5183eede52e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:28:40.063559 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-95b3a6f7-e4de-4b63-aff8-b5183eede52e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:28:40.073856 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-95b3a6f7-e4de-4b63-aff8-b5183eede52e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:40.074348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-95b3a6f7-e4de-4b63-aff8-b5183eede52e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:40.075221 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-95b3a6f7-e4de-4b63-aff8-b5183eede52e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:40.075663 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-95b3a6f7-e4de-4b63-aff8-b5183eede52e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:40.097819 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-95b3a6f7-e4de-4b63-aff8-b5183eede52e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Getting quotas for project 4a76d6db5fba43409430f5f9920c2943. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:28:40.102679 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-95b3a6f7-e4de-4b63-aff8-b5183eede52e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Getting quotas for user 010b37124c114e37966a0e22a24d5b91 and project 4a76d6db5fba43409430f5f9920c2943. Resources: {'instances', 'ram', 'cores'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:28:40.164786 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-95b3a6f7-e4de-4b63-aff8-b5183eede52e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:28:40.166884 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-95b3a6f7-e4de-4b63-aff8-b5183eede52e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e78a4e3c-2bbc-412b-bc58-ae2332768bee',volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:28:40.292337 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-95b3a6f7-e4de-4b63-aff8-b5183eede52e tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.728976 Jun 07 13:28:40.292982 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 651/1304] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jun 7 13:28:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 13:28:40.301588 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a861d805-4a7e-43c2-82dc-045f573b2f08] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 13:28:40.302189 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=40 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:40.303064 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=1 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:40.307426 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-217b1a19-aa69-4f1e-9771-6afbaf157192 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:40.308137 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-217b1a19-aa69-4f1e-9771-6afbaf157192 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:40.368151 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-217b1a19-aa69-4f1e-9771-6afbaf157192 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:40.381133 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-217b1a19-aa69-4f1e-9771-6afbaf157192 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1092 microversion: 2.1 time: 0.081896 Jun 07 13:28:40.381907 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 654/1305] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:40 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1092 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:41.401605 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b303e417-b0f8-4561-b318-f190e8ad5c2d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:41.402340 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b303e417-b0f8-4561-b318-f190e8ad5c2d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:41.411174 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO oslo.messaging._drivers.impl_rabbit [-] [77bba584-d6ae-4a71-85e3-d82570c966d7] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 33116. Jun 07 13:28:41.416107 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b303e417-b0f8-4561-b318-f190e8ad5c2d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:41.416596 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b303e417-b0f8-4561-b318-f190e8ad5c2d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:41.417366 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b303e417-b0f8-4561-b318-f190e8ad5c2d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:41.417797 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b303e417-b0f8-4561-b318-f190e8ad5c2d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:41.504081 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b303e417-b0f8-4561-b318-f190e8ad5c2d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:41.512759 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b303e417-b0f8-4561-b318-f190e8ad5c2d tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1208 microversion: 2.1 time: 0.118691 Jun 07 13:28:41.513348 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 652/1306] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:41 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1208 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:28:42.531661 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-3c8bda49-8d96-4d24-ba62-4e7075c1af86 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:42.532542 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-3c8bda49-8d96-4d24-ba62-4e7075c1af86 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:42.540112 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3c8bda49-8d96-4d24-ba62-4e7075c1af86 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:42.540525 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3c8bda49-8d96-4d24-ba62-4e7075c1af86 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:42.541488 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3c8bda49-8d96-4d24-ba62-4e7075c1af86 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:42.541928 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-3c8bda49-8d96-4d24-ba62-4e7075c1af86 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:42.563412 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO oslo.messaging._drivers.impl_rabbit [-] [a861d805-4a7e-43c2-82dc-045f573b2f08] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 33120. Jun 07 13:28:42.697949 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-3c8bda49-8d96-4d24-ba62-4e7075c1af86 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:42.707085 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-3c8bda49-8d96-4d24-ba62-4e7075c1af86 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1264 microversion: 2.1 time: 0.179667 Jun 07 13:28:42.707681 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 655/1307] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:42 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:42.803430 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-76d8ad01-cbab-4d40-aeb5-a92353de5cd3 req-c336be45-3e90-47d9-99be-24c6ac7c5b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb593c0-c1ad-4252-871b-a99dff2b4697", "tag": "63a992a7-b33f-406c-ab4e-da25f37965bf"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:42.814070 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-76d8ad01-cbab-4d40-aeb5-a92353de5cd3 req-c336be45-3e90-47d9-99be-24c6ac7c5b5f service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:42.814925 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-76d8ad01-cbab-4d40-aeb5-a92353de5cd3 req-c336be45-3e90-47d9-99be-24c6ac7c5b5f service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:42.828753 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-76d8ad01-cbab-4d40-aeb5-a92353de5cd3 req-c336be45-3e90-47d9-99be-24c6ac7c5b5f service nova] Creating event network-changed:63a992a7-b33f-406c-ab4e-da25f37965bf for instance 3cb593c0-c1ad-4252-871b-a99dff2b4697 on hv-cinder-84496 Jun 07 13:28:42.834556 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-76d8ad01-cbab-4d40-aeb5-a92353de5cd3 req-c336be45-3e90-47d9-99be-24c6ac7c5b5f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035279 Jun 07 13:28:42.835928 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 653/1308] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:43.726557 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-9bb33228-dcea-4acd-9afc-b366df8ceb48 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:43.727222 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-9bb33228-dcea-4acd-9afc-b366df8ceb48 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:43.733795 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9bb33228-dcea-4acd-9afc-b366df8ceb48 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:43.734245 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9bb33228-dcea-4acd-9afc-b366df8ceb48 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:43.735036 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9bb33228-dcea-4acd-9afc-b366df8ceb48 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:43.735474 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-9bb33228-dcea-4acd-9afc-b366df8ceb48 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:43.865580 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-9bb33228-dcea-4acd-9afc-b366df8ceb48 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:43.873279 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-9bb33228-dcea-4acd-9afc-b366df8ceb48 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1264 microversion: 2.1 time: 0.150572 Jun 07 13:28:43.873853 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 656/1309] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:43 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:44.891874 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4c28e295-b79c-4a30-87fa-fd35c61d9a3b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:44.892621 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4c28e295-b79c-4a30-87fa-fd35c61d9a3b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:44.900012 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c28e295-b79c-4a30-87fa-fd35c61d9a3b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:44.900463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c28e295-b79c-4a30-87fa-fd35c61d9a3b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:44.901518 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c28e295-b79c-4a30-87fa-fd35c61d9a3b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:44.901991 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c28e295-b79c-4a30-87fa-fd35c61d9a3b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:45.041004 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4c28e295-b79c-4a30-87fa-fd35c61d9a3b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:45.051403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4c28e295-b79c-4a30-87fa-fd35c61d9a3b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1264 microversion: 2.1 time: 0.164403 Jun 07 13:28:45.051969 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 654/1310] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:44 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:46.067672 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-a984e6c5-3cea-43af-a5d0-7320998a1129 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:46.068286 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-a984e6c5-3cea-43af-a5d0-7320998a1129 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:46.075145 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a984e6c5-3cea-43af-a5d0-7320998a1129 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:46.075596 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a984e6c5-3cea-43af-a5d0-7320998a1129 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:46.076413 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a984e6c5-3cea-43af-a5d0-7320998a1129 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:46.076827 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-a984e6c5-3cea-43af-a5d0-7320998a1129 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:46.209469 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-a984e6c5-3cea-43af-a5d0-7320998a1129 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:46.217292 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-a984e6c5-3cea-43af-a5d0-7320998a1129 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1264 microversion: 2.1 time: 0.153400 Jun 07 13:28:46.217872 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 657/1311] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:46 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:47.234015 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bb568180-01e7-4846-bae9-d1349492ddbd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:47.234694 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bb568180-01e7-4846-bae9-d1349492ddbd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:47.241875 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb568180-01e7-4846-bae9-d1349492ddbd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:47.242329 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb568180-01e7-4846-bae9-d1349492ddbd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:47.243132 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb568180-01e7-4846-bae9-d1349492ddbd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:47.243599 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb568180-01e7-4846-bae9-d1349492ddbd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:47.378852 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bb568180-01e7-4846-bae9-d1349492ddbd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:47.386923 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bb568180-01e7-4846-bae9-d1349492ddbd tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1264 microversion: 2.1 time: 0.156757 Jun 07 13:28:47.387502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 655/1312] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:47 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:48.404379 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-4ea5901d-8c02-4d4d-9e36-340e0bf7f19b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:48.404986 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-4ea5901d-8c02-4d4d-9e36-340e0bf7f19b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:48.411954 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4ea5901d-8c02-4d4d-9e36-340e0bf7f19b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:48.412380 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4ea5901d-8c02-4d4d-9e36-340e0bf7f19b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:48.413131 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4ea5901d-8c02-4d4d-9e36-340e0bf7f19b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:48.413559 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-4ea5901d-8c02-4d4d-9e36-340e0bf7f19b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:48.545467 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-4ea5901d-8c02-4d4d-9e36-340e0bf7f19b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:48.553795 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-4ea5901d-8c02-4d4d-9e36-340e0bf7f19b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1264 microversion: 2.1 time: 0.153458 Jun 07 13:28:48.554376 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 658/1313] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:48 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:49.570711 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-18b8cf72-5bec-45c4-9f24-479098199916 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:49.571327 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-18b8cf72-5bec-45c4-9f24-479098199916 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:49.577983 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-18b8cf72-5bec-45c4-9f24-479098199916 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:49.578463 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-18b8cf72-5bec-45c4-9f24-479098199916 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:49.579238 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-18b8cf72-5bec-45c4-9f24-479098199916 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:49.579675 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-18b8cf72-5bec-45c4-9f24-479098199916 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:49.713061 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-18b8cf72-5bec-45c4-9f24-479098199916 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:49.720513 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-18b8cf72-5bec-45c4-9f24-479098199916 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1264 microversion: 2.1 time: 0.153727 Jun 07 13:28:49.721077 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 656/1314] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:49 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:28:50.737341 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-43cf7885-6ee4-4d01-8afb-7df1fa9361d2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:50.737938 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-43cf7885-6ee4-4d01-8afb-7df1fa9361d2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:50.740286 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell0:SELECT=2 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:50.745191 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-43cf7885-6ee4-4d01-8afb-7df1fa9361d2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:50.745634 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-43cf7885-6ee4-4d01-8afb-7df1fa9361d2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:50.746419 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-43cf7885-6ee4-4d01-8afb-7df1fa9361d2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:50.746904 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-43cf7885-6ee4-4d01-8afb-7df1fa9361d2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:50.887888 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-43cf7885-6ee4-4d01-8afb-7df1fa9361d2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:50.896010 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-43cf7885-6ee4-4d01-8afb-7df1fa9361d2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1264 microversion: 2.1 time: 0.162610 Jun 07 13:28:50.896589 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 659/1315] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:50 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:51.912801 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-714a8b1a-4da9-415b-b85e-ecd3b6a63ef3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:51.913566 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-714a8b1a-4da9-415b-b85e-ecd3b6a63ef3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:51.916375 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:51.916375 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:51.923651 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-714a8b1a-4da9-415b-b85e-ecd3b6a63ef3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:51.924105 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-714a8b1a-4da9-415b-b85e-ecd3b6a63ef3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:51.925162 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-714a8b1a-4da9-415b-b85e-ecd3b6a63ef3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:51.925614 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-714a8b1a-4da9-415b-b85e-ecd3b6a63ef3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:52.249171 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-714a8b1a-4da9-415b-b85e-ecd3b6a63ef3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:52.257331 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-714a8b1a-4da9-415b-b85e-ecd3b6a63ef3 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1264 microversion: 2.1 time: 0.349031 Jun 07 13:28:52.257887 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 657/1316] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:51 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1264 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:53.251662 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [req-14322d4d-601d-4dbe-9c3c-fd1783604ef9 req-efcbabb0-72ad-4cec-9ebf-4e3644a133ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb593c0-c1ad-4252-871b-a99dff2b4697", "name": "network-vif-plugged", "status": "completed", "tag": "63a992a7-b33f-406c-ab4e-da25f37965bf"}]} {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:53.261455 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-14322d4d-601d-4dbe-9c3c-fd1783604ef9 req-efcbabb0-72ad-4cec-9ebf-4e3644a133ea service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:53.262316 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [req-14322d4d-601d-4dbe-9c3c-fd1783604ef9 req-efcbabb0-72ad-4cec-9ebf-4e3644a133ea service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:53.273280 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.compute.server_external_events [req-14322d4d-601d-4dbe-9c3c-fd1783604ef9 req-efcbabb0-72ad-4cec-9ebf-4e3644a133ea service nova] Creating event network-vif-plugged:63a992a7-b33f-406c-ab4e-da25f37965bf for instance 3cb593c0-c1ad-4252-871b-a99dff2b4697 on hv-cinder-84496 Jun 07 13:28:53.274186 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-63c6b637-2dc6-4ca3-96fe-518a87c17cfb tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:53.274831 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-63c6b637-2dc6-4ca3-96fe-518a87c17cfb tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:53.278834 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [req-14322d4d-601d-4dbe-9c3c-fd1783604ef9 req-efcbabb0-72ad-4cec-9ebf-4e3644a133ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030769 Jun 07 13:28:53.279591 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 660/1317] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:53.283082 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-63c6b637-2dc6-4ca3-96fe-518a87c17cfb tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:53.283536 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-63c6b637-2dc6-4ca3-96fe-518a87c17cfb tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:53.284260 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-63c6b637-2dc6-4ca3-96fe-518a87c17cfb tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:53.284697 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-63c6b637-2dc6-4ca3-96fe-518a87c17cfb tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:53.426185 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-63c6b637-2dc6-4ca3-96fe-518a87c17cfb tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:53.435457 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-63c6b637-2dc6-4ca3-96fe-518a87c17cfb tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1264 microversion: 2.1 time: 0.164720 Jun 07 13:28:53.436456 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 658/1318] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:53 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:28:54.454215 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-71f06f56-3adf-4cce-b7b9-787f5a058766 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:54.454961 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-71f06f56-3adf-4cce-b7b9-787f5a058766 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:54.461896 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-71f06f56-3adf-4cce-b7b9-787f5a058766 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:54.462350 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-71f06f56-3adf-4cce-b7b9-787f5a058766 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:54.463154 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-71f06f56-3adf-4cce-b7b9-787f5a058766 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:54.463593 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-71f06f56-3adf-4cce-b7b9-787f5a058766 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:54.599543 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-71f06f56-3adf-4cce-b7b9-787f5a058766 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:54.607067 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-71f06f56-3adf-4cce-b7b9-787f5a058766 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1264 microversion: 2.1 time: 0.157545 Jun 07 13:28:54.607637 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 661/1319] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:54 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:55.623268 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-14fd94c7-fce7-4ab8-b6de-7937cb3e3eec tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:55.623871 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-14fd94c7-fce7-4ab8-b6de-7937cb3e3eec tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:55.631090 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14fd94c7-fce7-4ab8-b6de-7937cb3e3eec tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:55.631543 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14fd94c7-fce7-4ab8-b6de-7937cb3e3eec tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:55.632320 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14fd94c7-fce7-4ab8-b6de-7937cb3e3eec tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:55.632758 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14fd94c7-fce7-4ab8-b6de-7937cb3e3eec tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:55.763326 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-14fd94c7-fce7-4ab8-b6de-7937cb3e3eec tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:55.771504 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-14fd94c7-fce7-4ab8-b6de-7937cb3e3eec tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1450 microversion: 2.1 time: 0.151669 Jun 07 13:28:55.771731 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 659/1320] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:55 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:55.787602 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5f896626-aaa0-466e-b990-926665fc5fa7 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:55.788601 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5f896626-aaa0-466e-b990-926665fc5fa7 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:55.796906 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5f896626-aaa0-466e-b990-926665fc5fa7 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:55.797363 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5f896626-aaa0-466e-b990-926665fc5fa7 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:55.798153 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5f896626-aaa0-466e-b990-926665fc5fa7 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:55.798641 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5f896626-aaa0-466e-b990-926665fc5fa7 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:55.931799 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5f896626-aaa0-466e-b990-926665fc5fa7 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:55.939483 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5f896626-aaa0-466e-b990-926665fc5fa7 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1450 microversion: 2.1 time: 0.155873 Jun 07 13:28:55.940056 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 662/1321] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:55 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:56.881412 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:28:56.881991 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Tue Jun 7 13:28:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:28:57.782594 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-e56d6845-096e-486f-9f39-2e61db525233 req-fce45400-79d1-4aa8-bff7-d2a7a5dabb2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb593c0-c1ad-4252-871b-a99dff2b4697", "tag": "63a992a7-b33f-406c-ab4e-da25f37965bf"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:57.793009 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-e56d6845-096e-486f-9f39-2e61db525233 req-fce45400-79d1-4aa8-bff7-d2a7a5dabb2f service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:57.793448 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-e56d6845-096e-486f-9f39-2e61db525233 req-fce45400-79d1-4aa8-bff7-d2a7a5dabb2f service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:57.804295 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-e56d6845-096e-486f-9f39-2e61db525233 req-fce45400-79d1-4aa8-bff7-d2a7a5dabb2f service nova] Creating event network-changed:63a992a7-b33f-406c-ab4e-da25f37965bf for instance 3cb593c0-c1ad-4252-871b-a99dff2b4697 on hv-cinder-84496 Jun 07 13:28:57.809130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-e56d6845-096e-486f-9f39-2e61db525233 req-fce45400-79d1-4aa8-bff7-d2a7a5dabb2f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102511 Jun 07 13:28:57.809710 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 660/1322] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:29:07.317459 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:29:07.318079 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Tue Jun 7 13:29:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:30:47.580877 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_api:SELECT=20 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:30:47.581635 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG dbcounter [-] [117797] Writing DB stats nova_cell1:SELECT=44 {{(pid=117797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:30:47.584274 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR oslo.messaging._drivers.impl_rabbit [-] [77bba584-d6ae-4a71-85e3-d82570c966d7] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 07 13:30:47.585152 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:30:47.586096 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=48 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:30:47.588380 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-15fb6882-8f97-4cdf-9b10-8a97c641a9c8 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:30:47.588931 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-15fb6882-8f97-4cdf-9b10-8a97c641a9c8 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:30:47.590798 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-89356a7d-e240-426a-a803-9634a87f2141 req-b720800c-b244-47c1-92da-0b88ac037070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb593c0-c1ad-4252-871b-a99dff2b4697", "tag": "63a992a7-b33f-406c-ab4e-da25f37965bf"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:30:47.596937 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-15fb6882-8f97-4cdf-9b10-8a97c641a9c8 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:47.597397 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-15fb6882-8f97-4cdf-9b10-8a97c641a9c8 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:47.598233 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-15fb6882-8f97-4cdf-9b10-8a97c641a9c8 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:47.598651 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-15fb6882-8f97-4cdf-9b10-8a97c641a9c8 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:47.601660 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-89356a7d-e240-426a-a803-9634a87f2141 req-b720800c-b244-47c1-92da-0b88ac037070 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:47.602252 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-89356a7d-e240-426a-a803-9634a87f2141 req-b720800c-b244-47c1-92da-0b88ac037070 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:47.613500 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-89356a7d-e240-426a-a803-9634a87f2141 req-b720800c-b244-47c1-92da-0b88ac037070 service nova] Creating event network-changed:63a992a7-b33f-406c-ab4e-da25f37965bf for instance 3cb593c0-c1ad-4252-871b-a99dff2b4697 on hv-cinder-84496 Jun 07 13:30:47.618759 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-89356a7d-e240-426a-a803-9634a87f2141 req-b720800c-b244-47c1-92da-0b88ac037070 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037096 Jun 07 13:30:47.619663 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 661/1323] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:30:47.628460 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-15fb6882-8f97-4cdf-9b10-8a97c641a9c8 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Going to try to terminate instance {{(pid=117797) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:30:47.711333 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-15fb6882-8f97-4cdf-9b10-8a97c641a9c8 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 204 len: 0 microversion: 2.1 time: 0.132665 Jun 07 13:30:47.711909 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 663/1324] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:30:47 2022] DELETE /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:30:47.720529 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b2b56235-b5e0-48a3-a3be-5a2b3a9f567b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:30:47.721230 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b2b56235-b5e0-48a3-a3be-5a2b3a9f567b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:30:47.727628 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b2b56235-b5e0-48a3-a3be-5a2b3a9f567b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:47.728070 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b2b56235-b5e0-48a3-a3be-5a2b3a9f567b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:47.728835 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b2b56235-b5e0-48a3-a3be-5a2b3a9f567b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:47.729265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b2b56235-b5e0-48a3-a3be-5a2b3a9f567b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:47.893596 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b2b56235-b5e0-48a3-a3be-5a2b3a9f567b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:30:47.901479 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b2b56235-b5e0-48a3-a3be-5a2b3a9f567b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1575 microversion: 2.1 time: 0.185158 Jun 07 13:30:47.902158 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 662/1325] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:30:47 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:30:48.919663 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-909a0e0b-0795-4de5-9f07-44a742449cf2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:30:48.920285 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-909a0e0b-0795-4de5-9f07-44a742449cf2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:30:48.926764 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-909a0e0b-0795-4de5-9f07-44a742449cf2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:48.927219 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-909a0e0b-0795-4de5-9f07-44a742449cf2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:48.928027 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-909a0e0b-0795-4de5-9f07-44a742449cf2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:48.928505 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-909a0e0b-0795-4de5-9f07-44a742449cf2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:49.121632 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-909a0e0b-0795-4de5-9f07-44a742449cf2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:30:49.129950 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-909a0e0b-0795-4de5-9f07-44a742449cf2 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1575 microversion: 2.1 time: 0.214686 Jun 07 13:30:49.130554 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 664/1326] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:30:48 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:30:50.035713 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO oslo.messaging._drivers.impl_rabbit [-] [77bba584-d6ae-4a71-85e3-d82570c966d7] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 33222. Jun 07 13:30:50.086473 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-f5f97366-bbef-41a2-8aad-6adaacbadbf1 req-35b0dc0e-cdc8-4e22-9b17-08914e898422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb593c0-c1ad-4252-871b-a99dff2b4697", "name": "network-vif-deleted", "tag": "63a992a7-b33f-406c-ab4e-da25f37965bf"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:30:50.094694 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-f5f97366-bbef-41a2-8aad-6adaacbadbf1 req-35b0dc0e-cdc8-4e22-9b17-08914e898422 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:50.095143 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-f5f97366-bbef-41a2-8aad-6adaacbadbf1 req-35b0dc0e-cdc8-4e22-9b17-08914e898422 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:50.105668 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-f5f97366-bbef-41a2-8aad-6adaacbadbf1 req-35b0dc0e-cdc8-4e22-9b17-08914e898422 service nova] Creating event network-vif-deleted:63a992a7-b33f-406c-ab4e-da25f37965bf for instance 3cb593c0-c1ad-4252-871b-a99dff2b4697 on hv-cinder-84496 Jun 07 13:30:50.110375 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-f5f97366-bbef-41a2-8aad-6adaacbadbf1 req-35b0dc0e-cdc8-4e22-9b17-08914e898422 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087525 Jun 07 13:30:50.111044 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 663/1327] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:30:50.147366 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-04feed02-d97f-4739-b626-8c55eb8424a6 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:30:50.147875 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-04feed02-d97f-4739-b626-8c55eb8424a6 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:30:50.155272 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-04feed02-d97f-4739-b626-8c55eb8424a6 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:50.155739 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-04feed02-d97f-4739-b626-8c55eb8424a6 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:50.156535 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-04feed02-d97f-4739-b626-8c55eb8424a6 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:50.156972 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-04feed02-d97f-4739-b626-8c55eb8424a6 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:50.216514 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-04feed02-d97f-4739-b626-8c55eb8424a6 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:30:50.224124 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-04feed02-d97f-4739-b626-8c55eb8424a6 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 200 len: 1223 microversion: 2.1 time: 0.080612 Jun 07 13:30:50.224639 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 665/1328] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:30:50 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:30:51.243158 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bb3d73e5-e1cf-4fde-beee-a6f834ef9f61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:30:51.243853 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bb3d73e5-e1cf-4fde-beee-a6f834ef9f61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 3cb593c0-c1ad-4252-871b-a99dff2b4697] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:30:51.249939 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb3d73e5-e1cf-4fde-beee-a6f834ef9f61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:51.250390 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb3d73e5-e1cf-4fde-beee-a6f834ef9f61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:51.251780 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb3d73e5-e1cf-4fde-beee-a6f834ef9f61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:51.252209 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bb3d73e5-e1cf-4fde-beee-a6f834ef9f61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:51.267019 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-bb3d73e5-e1cf-4fde-beee-a6f834ef9f61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] HTTP exception thrown: Instance 3cb593c0-c1ad-4252-871b-a99dff2b4697 could not be found. Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bb3d73e5-e1cf-4fde-beee-a6f834ef9f61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Request method failure captured: Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 HTTP/1.1 Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin1D_0QtM6sg7Ez4qwVWHQIyGgPISu3CJ98LK_dWBQ6qYivQ20CFkZFDUL2X2Ba02HCB5Gun0Q4DK2U0aJKtyNrnP2MnEj1nwdDhECa5BKhEe5BCBsPvVjo4aHksL4TGXm36-gZlBslcyAekaqLaTaPRwMRg-ljJD5rPZ0jMuQiQQPBw Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 4a76d6db5fba43409430f5f9920c2943 Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-TestVolumeBootPattern-634091109 Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:30:51.268618 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:30:51.270370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4a76d6db5fba43409430f5f9920c2943", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4a76d6db5fba43409430f5f9920c2943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a76d6db5fba43409430f5f9920c2943"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a76d6db5fba43409430f5f9920c2943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:30:51.270370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-TestVolumeBootPattern-634091109 Jun 07 13:30:51.270370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 4a76d6db5fba43409430f5f9920c2943 Jun 07 13:30:51.270370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-TestVolumeBootPattern-634091109 Jun 07 13:30:51.270370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-TestVolumeBootPattern-634091109-project Jun 07 13:30:51.270370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:30:51.270370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:30:51.270370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 010b37124c114e37966a0e22a24d5b91 Jun 07 13:30:51.270370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-TestVolumeBootPattern-634091109-project Jun 07 13:30:51.270370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:30:51.270370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance 3cb593c0-c1ad-4252-871b-a99dff2b4697 could not be found. Jun 07 13:30:51.270370 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': '3cb593c0-c1ad-4252-871b-a99dff2b4697'} Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cb593c0-c1ad-4252-871b-a99dff2b4697 could not be found. Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:30:51.271433 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cb593c0-c1ad-4252-871b-a99dff2b4697 could not be found. Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cb593c0-c1ad-4252-871b-a99dff2b4697 could not be found. Jun 07 13:30:51.273212 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:30:51.275191 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bb3d73e5-e1cf-4fde-beee-a6f834ef9f61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Returning 404 to user: Instance 3cb593c0-c1ad-4252-871b-a99dff2b4697 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:30:51.275191 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bb3d73e5-e1cf-4fde-beee-a6f834ef9f61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697" status: 404 len: 111 microversion: 2.1 time: 0.031501 Jun 07 13:30:51.275191 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 664/1329] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:30:51 2022] GET /compute/v2.1/servers/3cb593c0-c1ad-4252-871b-a99dff2b4697 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:30:54.300770 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-fe5e0dac-b41e-4b5c-b8cf-c76b8376ac61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:30:54.301321 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-fe5e0dac-b41e-4b5c-b8cf-c76b8376ac61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:30:54.302872 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-3753fbe5-3bb2-411d-8664-72485ca955a1 req-dfb27dc1-6955-496e-be61-7a4e336d9d33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c", "tag": "51d4f939-561d-4cea-ac43-bac8a7d80e32"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:30:54.308601 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fe5e0dac-b41e-4b5c-b8cf-c76b8376ac61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:54.309127 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fe5e0dac-b41e-4b5c-b8cf-c76b8376ac61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:54.309971 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fe5e0dac-b41e-4b5c-b8cf-c76b8376ac61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:54.310402 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-fe5e0dac-b41e-4b5c-b8cf-c76b8376ac61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:54.311988 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-3753fbe5-3bb2-411d-8664-72485ca955a1 req-dfb27dc1-6955-496e-be61-7a4e336d9d33 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:54.312502 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-3753fbe5-3bb2-411d-8664-72485ca955a1 req-dfb27dc1-6955-496e-be61-7a4e336d9d33 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:54.324581 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-3753fbe5-3bb2-411d-8664-72485ca955a1 req-dfb27dc1-6955-496e-be61-7a4e336d9d33 service nova] Creating event network-changed:51d4f939-561d-4cea-ac43-bac8a7d80e32 for instance e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c on hv-cinder-84496 Jun 07 13:30:54.330599 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-3753fbe5-3bb2-411d-8664-72485ca955a1 req-dfb27dc1-6955-496e-be61-7a4e336d9d33 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031519 Jun 07 13:30:54.331522 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 665/1330] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:30:54.337140 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-fe5e0dac-b41e-4b5c-b8cf-c76b8376ac61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Going to try to terminate instance {{(pid=117797) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:30:54.426350 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-fe5e0dac-b41e-4b5c-b8cf-c76b8376ac61 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 204 len: 0 microversion: 2.1 time: 0.128765 Jun 07 13:30:54.427062 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 666/1331] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:30:54 2022] DELETE /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:30:54.437202 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1fc52acf-e358-4ee2-80b8-adc06bb07b9a tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:30:54.438156 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1fc52acf-e358-4ee2-80b8-adc06bb07b9a tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:30:54.445016 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1fc52acf-e358-4ee2-80b8-adc06bb07b9a tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:54.445485 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1fc52acf-e358-4ee2-80b8-adc06bb07b9a tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:54.446265 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1fc52acf-e358-4ee2-80b8-adc06bb07b9a tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:54.446765 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1fc52acf-e358-4ee2-80b8-adc06bb07b9a tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:54.588689 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1fc52acf-e358-4ee2-80b8-adc06bb07b9a tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:30:54.597784 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1fc52acf-e358-4ee2-80b8-adc06bb07b9a tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1577 microversion: 2.1 time: 0.165163 Jun 07 13:30:54.598823 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 666/1332] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:30:54 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:30:55.617985 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-26941004-8661-4241-afa4-6465f0ba761b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:30:55.618716 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-26941004-8661-4241-afa4-6465f0ba761b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:30:55.625249 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-26941004-8661-4241-afa4-6465f0ba761b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:55.625773 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-26941004-8661-4241-afa4-6465f0ba761b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:55.626635 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-26941004-8661-4241-afa4-6465f0ba761b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:55.627309 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-26941004-8661-4241-afa4-6465f0ba761b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:55.771547 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-26941004-8661-4241-afa4-6465f0ba761b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:30:55.779414 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-26941004-8661-4241-afa4-6465f0ba761b tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1577 microversion: 2.1 time: 0.165807 Jun 07 13:30:55.779988 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 667/1333] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:30:55 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:30:56.736740 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-f1d84a5c-c851-41e3-abfc-347a8d061016 req-0dbee760-63c2-4b01-bb4a-5cdcca41eb42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c", "name": "network-vif-deleted", "tag": "51d4f939-561d-4cea-ac43-bac8a7d80e32"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:30:56.745254 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-f1d84a5c-c851-41e3-abfc-347a8d061016 req-0dbee760-63c2-4b01-bb4a-5cdcca41eb42 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:56.745702 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-f1d84a5c-c851-41e3-abfc-347a8d061016 req-0dbee760-63c2-4b01-bb4a-5cdcca41eb42 service nova] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:56.756524 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-f1d84a5c-c851-41e3-abfc-347a8d061016 req-0dbee760-63c2-4b01-bb4a-5cdcca41eb42 service nova] Creating event network-vif-deleted:51d4f939-561d-4cea-ac43-bac8a7d80e32 for instance e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c on hv-cinder-84496 Jun 07 13:30:56.761040 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-f1d84a5c-c851-41e3-abfc-347a8d061016 req-0dbee760-63c2-4b01-bb4a-5cdcca41eb42 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028037 Jun 07 13:30:56.761604 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 667/1334] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jun 7 13:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:30:56.796789 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-5aece1ca-af1c-4cd4-953c-e572005b0481 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:30:56.797540 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-5aece1ca-af1c-4cd4-953c-e572005b0481 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:30:56.804046 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5aece1ca-af1c-4cd4-953c-e572005b0481 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:56.804489 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5aece1ca-af1c-4cd4-953c-e572005b0481 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:56.805245 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5aece1ca-af1c-4cd4-953c-e572005b0481 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:56.805674 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-5aece1ca-af1c-4cd4-953c-e572005b0481 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:56.868823 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.policy [None req-5aece1ca-af1c-4cd4-953c-e572005b0481 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010b37124c114e37966a0e22a24d5b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a76d6db5fba43409430f5f9920c2943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117797) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:30:56.877028 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-5aece1ca-af1c-4cd4-953c-e572005b0481 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 200 len: 1390 microversion: 2.1 time: 0.084099 Jun 07 13:30:56.877785 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 668/1335] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:30:56 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:30:57.894884 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d6696f4d-4b05-4a82-8c54-4fc021d71b84 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:30:57.895605 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d6696f4d-4b05-4a82-8c54-4fc021d71b84 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:30:57.901968 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d6696f4d-4b05-4a82-8c54-4fc021d71b84 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:57.902410 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d6696f4d-4b05-4a82-8c54-4fc021d71b84 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:57.903178 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d6696f4d-4b05-4a82-8c54-4fc021d71b84 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:57.903607 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d6696f4d-4b05-4a82-8c54-4fc021d71b84 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:57.916907 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-d6696f4d-4b05-4a82-8c54-4fc021d71b84 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] HTTP exception thrown: Instance e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c could not be found. Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d6696f4d-4b05-4a82-8c54-4fc021d71b84 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Request method failure captured: Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c HTTP/1.1 Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin1D_0QtM6sg7Ez4qwVWHQIyGgPISu3CJ98LK_dWBQ6qYivQ20CFkZFDUL2X2Ba02HCB5Gun0Q4DK2U0aJKtyNrnP2MnEj1nwdDhECa5BKhEe5BCBsPvVjo4aHksL4TGXm36-gZlBslcyAekaqLaTaPRwMRg-ljJD5rPZ0jMuQiQQPBw Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 4a76d6db5fba43409430f5f9920c2943 Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-TestVolumeBootPattern-634091109 Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:30:57.918516 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:30:57.920266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4a76d6db5fba43409430f5f9920c2943", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4a76d6db5fba43409430f5f9920c2943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a76d6db5fba43409430f5f9920c2943"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a76d6db5fba43409430f5f9920c2943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:30:57.920266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-TestVolumeBootPattern-634091109 Jun 07 13:30:57.920266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 4a76d6db5fba43409430f5f9920c2943 Jun 07 13:30:57.920266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-TestVolumeBootPattern-634091109 Jun 07 13:30:57.920266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-TestVolumeBootPattern-634091109-project Jun 07 13:30:57.920266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:30:57.920266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:30:57.920266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 010b37124c114e37966a0e22a24d5b91 Jun 07 13:30:57.920266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-TestVolumeBootPattern-634091109-project Jun 07 13:30:57.920266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:30:57.920266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c could not be found. Jun 07 13:30:57.920266 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': 'e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c'} Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c could not be found. Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:30:57.921131 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c could not be found. Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c could not be found. Jun 07 13:30:57.923403 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:30:57.925007 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d6696f4d-4b05-4a82-8c54-4fc021d71b84 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Returning 404 to user: Instance e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:30:57.925007 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d6696f4d-4b05-4a82-8c54-4fc021d71b84 tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c" status: 404 len: 111 microversion: 2.1 time: 0.029953 Jun 07 13:30:57.925007 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 668/1336] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:30:57 2022] GET /compute/v2.1/servers/e0c0f65d-8987-41fb-8e1a-a6ad4ad1723c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:30:58.349660 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0d357110-4904-444c-81c3-a9fbe42681be tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:30:58.350258 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.compute.api [None req-0d357110-4904-444c-81c3-a9fbe42681be tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117797) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:30:58.356830 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0d357110-4904-444c-81c3-a9fbe42681be tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:58.357334 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0d357110-4904-444c-81c3-a9fbe42681be tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:58.358047 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0d357110-4904-444c-81c3-a9fbe42681be tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:58.358508 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG oslo_concurrency.lockutils [None req-0d357110-4904-444c-81c3-a9fbe42681be tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:58.371525 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.wsgi [None req-0d357110-4904-444c-81c3-a9fbe42681be tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] HTTP exception thrown: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0d357110-4904-444c-81c3-a9fbe42681be tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Request method failure captured: Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: request: DELETE /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 HTTP/1.1 Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept: application/json Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Accept-Encoding: identity Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Connection: close Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Length: 0 Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Content-Type: application/json Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Host: 10.222.0.58 Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Openstack-System-Scope: None Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: User-Agent: python-urllib3/1.26.9 Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Auth-Token: gAAAAABin1D_0QtM6sg7Ez4qwVWHQIyGgPISu3CJ98LK_dWBQ6qYivQ20CFkZFDUL2X2Ba02HCB5Gun0Q4DK2U0aJKtyNrnP2MnEj1nwdDhECa5BKhEe5BCBsPvVjo4aHksL4TGXm36-gZlBslcyAekaqLaTaPRwMRg-ljJD5rPZ0jMuQiQQPBw Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Id: None Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Domain-Name: None Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Identity-Status: Confirmed Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Is-Admin-Project: True Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Id: default Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Domain-Name: Default Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Id: 4a76d6db5fba43409430f5f9920c2943 Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Project-Name: tempest-TestVolumeBootPattern-634091109 Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Role: member,reader Jun 07 13:30:58.373213 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Roles: member,reader Jun 07 13:30:58.374996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4a76d6db5fba43409430f5f9920c2943", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4a76d6db5fba43409430f5f9920c2943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a76d6db5fba43409430f5f9920c2943"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a76d6db5fba43409430f5f9920c2943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:30:58.374996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant: tempest-TestVolumeBootPattern-634091109 Jun 07 13:30:58.374996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Id: 4a76d6db5fba43409430f5f9920c2943 Jun 07 13:30:58.374996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-Tenant-Name: tempest-TestVolumeBootPattern-634091109 Jun 07 13:30:58.374996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User: tempest-TestVolumeBootPattern-634091109-project Jun 07 13:30:58.374996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Id: default Jun 07 13:30:58.374996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Domain-Name: Default Jun 07 13:30:58.374996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Id: 010b37124c114e37966a0e22a24d5b91 Jun 07 13:30:58.374996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: X-User-Name: tempest-TestVolumeBootPattern-634091109-project Jun 07 13:30:58.374996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: method: > Jun 07 13:30:58.374996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: exception: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. Jun 07 13:30:58.374996 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: action_args: {'id': '2f62c387-9b2e-4a04-bcf7-db7d688bd6f2'} Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:30:58.376049 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. Jun 07 13:30:58.377652 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: ERROR nova.api.openstack.wsgi Jun 07 13:30:58.379614 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-0d357110-4904-444c-81c3-a9fbe42681be tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Returning 404 to user: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. {{(pid=117797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:30:58.379614 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-0d357110-4904-444c-81c3-a9fbe42681be tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 404 len: 111 microversion: 2.1 time: 0.028875 Jun 07 13:30:58.379614 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 669/1337] 10.222.0.58 () {58 vars in 1238 bytes} [Tue Jun 7 13:30:58 2022] DELETE /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:30:58.382977 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e850526c-536b-4328-9f10-951c84257bfe tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:30:58.383588 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e850526c-536b-4328-9f10-951c84257bfe tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] [instance: 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:30:58.389652 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e850526c-536b-4328-9f10-951c84257bfe tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:58.390105 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e850526c-536b-4328-9f10-951c84257bfe tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:58.390908 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e850526c-536b-4328-9f10-951c84257bfe tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:30:58.391838 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e850526c-536b-4328-9f10-951c84257bfe tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Lock "ea3ea752-fefa-4f40-8c99-d2fb2240d3ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:30:58.405549 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-e850526c-536b-4328-9f10-951c84257bfe tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] HTTP exception thrown: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e850526c-536b-4328-9f10-951c84257bfe tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Request method failure captured: Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 HTTP/1.1 Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept: application/json Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Connection: close Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Length: 0 Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Content-Type: application/json Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Host: 10.222.0.58 Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABin1D_0QtM6sg7Ez4qwVWHQIyGgPISu3CJ98LK_dWBQ6qYivQ20CFkZFDUL2X2Ba02HCB5Gun0Q4DK2U0aJKtyNrnP2MnEj1nwdDhECa5BKhEe5BCBsPvVjo4aHksL4TGXm36-gZlBslcyAekaqLaTaPRwMRg-ljJD5rPZ0jMuQiQQPBw Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Id: None Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Domain-Name: None Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Id: 4a76d6db5fba43409430f5f9920c2943 Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-TestVolumeBootPattern-634091109 Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Role: member,reader Jun 07 13:30:58.408130 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Roles: member,reader Jun 07 13:30:58.410020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4a76d6db5fba43409430f5f9920c2943", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4a76d6db5fba43409430f5f9920c2943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a76d6db5fba43409430f5f9920c2943"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a76d6db5fba43409430f5f9920c2943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Jun 07 13:30:58.410020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-TestVolumeBootPattern-634091109 Jun 07 13:30:58.410020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 4a76d6db5fba43409430f5f9920c2943 Jun 07 13:30:58.410020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-TestVolumeBootPattern-634091109 Jun 07 13:30:58.410020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User: tempest-TestVolumeBootPattern-634091109-project Jun 07 13:30:58.410020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default Jun 07 13:30:58.410020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default Jun 07 13:30:58.410020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Id: 010b37124c114e37966a0e22a24d5b91 Jun 07 13:30:58.410020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-TestVolumeBootPattern-634091109-project Jun 07 13:30:58.410020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: method: > Jun 07 13:30:58.410020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: exception: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. Jun 07 13:30:58.410020 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: action_args: {'id': '2f62c387-9b2e-4a04-bcf7-db7d688bd6f2'} Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:30:58.410956 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. Jun 07 13:30:58.412347 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Jun 07 13:30:58.413751 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e850526c-536b-4328-9f10-951c84257bfe tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Returning 404 to user: Instance 2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:30:58.413751 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e850526c-536b-4328-9f10-951c84257bfe tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2" status: 404 len: 111 microversion: 2.1 time: 0.029792 Jun 07 13:30:58.413751 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 669/1338] 10.222.0.58 () {58 vars in 1235 bytes} [Tue Jun 7 13:30:58 2022] GET /compute/v2.1/servers/2f62c387-9b2e-4a04-bcf7-db7d688bd6f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:30:59.701177 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: DEBUG nova.api.openstack.wsgi [None req-46914246-db1c-4430-887c-8b32619316be tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] Calling method '.version_select at 0x7fb8e790e9d0>' {{(pid=117797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:30:59.727621 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO nova.api.openstack.requestlog [None req-46914246-db1c-4430-887c-8b32619316be tempest-TestVolumeBootPattern-634091109 tempest-TestVolumeBootPattern-634091109-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-34190129" status: 202 len: 0 microversion: 2.1 time: 0.031017 Jun 07 13:30:59.728599 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: [pid: 117797|app: 0|req: 670/1339] 10.222.0.58 () {58 vars in 1256 bytes} [Tue Jun 7 13:30:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-34190129 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:31:18.923833 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:31:18.924439 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Tue Jun 7 13:31:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:31:43.448623 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:31:43.449250 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Tue Jun 7 13:31:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:33:56.892345 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:33:56.893015 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Tue Jun 7 13:33:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:34:07.326141 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:34:07.326801 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Tue Jun 7 13:34:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:34:10.064794 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:34:10.065343 dv-cinder-844964-1-iscsi devstack@n-api.service[117798]: Tue Jun 7 13:34:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:34:22.883197 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:34:22.883724 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Tue Jun 7 13:34:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:36:18.932095 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:36:18.932736 dv-cinder-844964-1-iscsi devstack@n-api.service[117797]: Tue Jun 7 13:36:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!